-- Logs begin at Mon 2022-07-25 11:56:37 UTC, end at Mon 2022-07-25 13:10:47 UTC. -- Jul 25 12:30:53.779777 dv-cinder-825492-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:30:53.787012 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:30:53 2022] *** Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: nodename: dv-cinder-825492-28-iscsi Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: machine: x86_64 Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: clock source: unix Jul 25 12:30:53.789011 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: pcre jit disabled Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: detected number of CPU cores: 4 Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: current working directory: / Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: your processes number limit is 47680 Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: your memory page size is 4096 bytes Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: detected max file descriptor number: 2048 Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: lock engine: pthread robust mutexes Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: thunder lock: enabled Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:30:53.789484 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:30:53.830144 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: Python main interpreter initialized at 0x55e718d889c0 Jul 25 12:30:53.830144 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: python threads support enabled Jul 25 12:30:53.830144 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: your server socket listen backlog is limited to 100 connections Jul 25 12:30:53.830144 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:30:53.830538 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:30:53.830614 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: *** Operational MODE: preforking *** Jul 25 12:30:53.830849 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:30:53.830849 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: spawned uWSGI master process (pid: 104936) Jul 25 12:30:53.831047 dv-cinder-825492-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:30:53.832118 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: spawned uWSGI worker 1 (pid: 104937, cores: 1) Jul 25 12:30:53.832456 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: spawned uWSGI worker 2 (pid: 104938, cores: 1) Jul 25 12:30:53.832631 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:30:54.491528 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:30:54.492315 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:30:55.574430 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:30:55.574430 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: from cryptography.utils import int_from_bytes Jul 25 12:30:55.575024 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:30:55.575024 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: from cryptography.utils import int_from_bytes Jul 25 12:30:55.578971 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:30:55.578971 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: from cryptography.utils import int_from_bytes Jul 25 12:30:55.579389 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:30:55.579389 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: from cryptography.utils import int_from_bytes Jul 25 12:30:58.073675 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:30:58.074268 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:30:58.074498 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:30:58.074826 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:30:58.075006 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:30:58.075364 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:30:58.075451 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:30:58.075546 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.075763 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.075858 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:30:58.076082 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.076182 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:30:58.076357 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:30:58.076460 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.076719 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.076811 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077027 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077125 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077438 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077657 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.077756 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078006 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078165 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078255 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078335 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078569 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078664 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078891 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-28-iscsi {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.078994 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079208 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079305 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079471 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079557 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.079870 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080103 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-28-iscsi {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080191 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080404 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080489 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080709 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.080802 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.081016 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.081114 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.081354 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.081536 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.081648 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.082700 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.082856 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.082974 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083063 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083063 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083267 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083363 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083490 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083592 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083679 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083768 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083849 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.083933 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084059 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084143 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084284 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084402 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084540 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084707 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.084854 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085102 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-28-iscsi {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085190 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085414 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085501 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085722 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.085817 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086063 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086222 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-28-iscsi {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086471 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086566 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.086862 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087084 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087179 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087398 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087485 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087728 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.087813 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.088034 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.088130 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.088359 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.088446 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.088912 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089036 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089036 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089211 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089292 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089377 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089579 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089672 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089884 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.089985 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090212 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090299 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090510 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090607 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090816 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.090904 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091116 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091217 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091367 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091467 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091673 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091761 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.091993 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092080 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092239 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092333 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092543 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092630 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092850 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.092937 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093098 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093196 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093415 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093502 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093700 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093809 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.093970 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094074 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094288 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094377 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094606 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094709 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094910 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.094998 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095211 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095303 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095510 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095613 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095811 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.095897 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096109 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096202 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096410 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096505 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096712 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.096808 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097040 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097134 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097347 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097518 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097653 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097747 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.097990 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098080 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098295 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098390 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098599 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098684 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.098933 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099027 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099223 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099316 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099527 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099622 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099845 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.099937 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100162 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100248 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100464 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100563 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100767 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.100854 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101070 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101164 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101375 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101475 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101677 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.101778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102002 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102095 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102251 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102339 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102548 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102645 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102848 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.102971 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103156 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103253 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103451 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103552 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103750 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.103861 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104045 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104150 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104341 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104440 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104638 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104723 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.104935 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.105020 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.105480 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.105576 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.105780 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.105875 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106110 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106228 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106416 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106532 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106718 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.106834 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107021 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107136 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107322 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107435 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107636 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107734 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.107952 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108039 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108255 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108351 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108556 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108642 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108856 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.108951 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109158 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109251 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109474 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109562 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109770 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.109869 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110095 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110185 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110408 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110494 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110709 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.110802 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111009 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111102 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111321 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111410 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111623 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111710 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.111920 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.112006 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.112232 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.112316 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113057 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113167 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113355 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113448 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113667 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113754 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.113984 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114091 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114286 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114418 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114587 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114711 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114885 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.114981 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115183 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115275 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115479 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115564 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115776 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.115871 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116071 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116157 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116365 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116451 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116659 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116754 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.116957 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117044 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117253 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117351 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117653 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.117866 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118000 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118196 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118292 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118499 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118599 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.118800 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.118887 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.119114 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:30:58.119201 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.119444 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.119532 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.119770 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.119871 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120096 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120202 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120410 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120505 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120714 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.120807 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121024 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121121 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121347 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121486 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121656 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121755 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.121985 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122088 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122295 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122382 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122605 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122689 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.122914 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123013 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123225 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123325 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123535 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123633 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123846 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.123941 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124157 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124251 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124463 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124550 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124771 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.124865 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125085 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125172 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125393 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125481 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125698 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.125794 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126044 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126144 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126362 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126457 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126670 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.126758 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127001 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127088 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127319 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127407 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127628 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127707 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.127938 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.128032 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.128805 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.128896 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129114 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129201 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129424 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129513 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129734 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.129822 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130068 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130170 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130379 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130474 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130689 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130783 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.130995 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131087 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131300 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131428 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131613 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131756 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.131913 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132010 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132221 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132309 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132526 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132622 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132833 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.132919 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133147 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133239 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133457 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133565 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133761 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.133845 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134092 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134179 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134396 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134505 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134702 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.134799 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135001 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135086 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135301 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135386 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135602 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135694 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135900 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.135984 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136207 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136294 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136511 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136592 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136829 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.136923 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137136 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137220 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137439 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137522 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137745 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.137828 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138076 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138163 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138381 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138478 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138689 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138781 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.138995 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139079 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139296 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139379 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139606 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139699 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139912 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.139996 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140211 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140301 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140528 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140620 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140831 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.140922 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141132 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141215 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141444 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141599 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141731 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.141816 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142062 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142165 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142371 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142459 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142678 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142764 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.142986 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143073 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143292 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143392 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143601 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.143947 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144035 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144258 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144346 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144559 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144651 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144882 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.144991 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145203 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145290 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145503 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145597 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145804 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.145899 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146136 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146223 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146441 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146536 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146749 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.146849 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147052 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147138 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147353 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147438 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147651 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147814 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.147949 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148035 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148247 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148333 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148546 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148640 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148844 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.148930 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149144 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149229 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149448 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149544 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149747 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.149841 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150073 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150173 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150378 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150467 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150678 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150763 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.150979 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151073 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151282 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151371 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151628 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151770 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.151922 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.152087 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.152260 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.152591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.152909 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.153231 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.155910 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156042 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156134 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156297 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156376 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156455 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156547 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156708 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156787 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156873 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.156960 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157048 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157128 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157253 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157349 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157433 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157513 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157604 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157685 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157772 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157851 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.157947 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158048 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158129 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158220 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158299 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158382 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158467 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158562 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158642 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158725 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158803 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158880 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.158956 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159042 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159128 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159353 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159483 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159675 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.159987 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.160156 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.160302 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.160522 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.160652 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.160876 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.161046 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.161251 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.161627 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.161732 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.162100 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.162306 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.162451 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.162773 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.162848 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.163095 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.163421 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.163567 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.163718 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.163868 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164030 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164270 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164362 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164593 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164688 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.164918 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166198 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166198 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166425 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166548 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166673 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166818 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.166948 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167053 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167155 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167269 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167375 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167486 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167694 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167797 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.167908 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168014 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168117 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168226 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168385 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168514 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168629 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168734 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168838 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.168968 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.169129 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.169355 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.169481 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.169845 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.169996 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.170241 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.170356 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.170619 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.170746 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.170935 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171056 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171241 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171351 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171550 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171664 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171863 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.171972 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172187 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172297 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172501 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172619 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172822 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.172932 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173254 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173385 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173500 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173612 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173739 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.173851 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.174212 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.174348 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.174526 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.174612 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.174869 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.175459 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.175710 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.175813 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176017 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176103 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176361 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176455 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176674 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176769 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.176979 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177072 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177298 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177384 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177620 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177715 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.177948 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178038 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178270 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178365 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178579 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178665 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178891 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.178976 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.179249 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.179335 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.179694 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.179806 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.179966 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.180089 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.180357 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.180443 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.180674 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.180803 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181058 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181186 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181369 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181480 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181692 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.181806 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182028 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182142 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182343 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182467 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182654 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182765 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.182959 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.183076 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.183375 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.183506 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.183622 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.183733 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184152 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184264 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184484 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184604 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184800 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.184926 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.185118 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.185229 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.185438 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.185559 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186201 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186304 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186387 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186479 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186559 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186636 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186743 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.186839 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187046 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187145 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187352 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187437 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187659 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187744 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.187959 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188045 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188268 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188360 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188570 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188662 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188873 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.188958 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189265 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189481 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189570 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189785 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.189878 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.190116 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.190221 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.190417 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.190508 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191285 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191380 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191601 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191908 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.191993 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192224 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192324 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192527 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192622 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192846 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.192929 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.193152 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.193243 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.193502 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.193647 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.193802 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.194077 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.194171 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.194616 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.194735 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.194918 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.195227 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.195336 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.195567 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.195700 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.195906 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196041 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196212 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196298 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196519 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196631 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196839 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.196950 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197148 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197283 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197434 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197587 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197718 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.197863 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198083 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198224 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198389 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198523 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198702 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.198836 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199008 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199146 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199291 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199503 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199648 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199787 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.199923 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200060 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200198 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200350 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200485 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200624 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200762 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.200909 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201060 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201213 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201364 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201514 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201646 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201783 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.201959 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202099 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202230 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202363 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202548 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202706 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.202858 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203002 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203204 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203352 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203507 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203674 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203834 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.203976 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204158 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204301 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204435 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204688 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204837 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.204963 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205049 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205127 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205204 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205292 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205468 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205566 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205773 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.205858 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206103 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206213 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206445 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206532 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206751 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.206845 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207053 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207148 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207356 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207449 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207659 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207745 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.207960 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208054 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208264 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208370 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208579 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208714 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.208906 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209023 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209218 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209339 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209566 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209747 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.209896 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.210251 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.210340 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.210554 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.210843 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.210918 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.211226 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.211406 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.211642 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.211946 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212020 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212246 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212423 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212550 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212854 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.212942 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.213178 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.213272 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.213487 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.213628 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.213848 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.214060 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.214388 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.214521 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.214954 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.215059 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.215369 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.215595 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.215780 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.216337 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.216470 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.216799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.217041 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.217176 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.223661 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.223828 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.223916 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.223987 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224068 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224151 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224241 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224321 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224398 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224476 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224552 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224635 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224722 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224801 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224879 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.224955 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225031 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225107 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225192 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225277 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225356 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225433 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225510 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225587 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225672 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225741 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225807 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225883 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.225972 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226111 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226204 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226274 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226354 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226440 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226519 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226605 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226684 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226768 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226847 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.226923 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227001 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227086 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227172 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227251 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227328 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227405 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227482 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227571 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227651 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227728 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227811 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227890 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.227975 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228055 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228132 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228210 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228287 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228370 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228792 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228886 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.228965 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229031 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229109 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229186 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229277 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229368 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229448 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229532 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229611 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229688 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229776 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229856 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.229947 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230027 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230387 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230475 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230475 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230617 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230694 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230856 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.230941 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231020 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231103 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231182 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231265 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231343 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.231427 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235020 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235154 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235271 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235271 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235513 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235644 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235730 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235806 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235806 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.235936 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236010 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236078 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236143 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236143 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236259 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236323 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236400 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236467 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236467 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236584 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236648 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236712 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236712 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236848 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236914 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.236914 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.237031 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.237096 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.237247 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.237316 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.238106 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.238406 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.238505 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.238734 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.238928 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.239153 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.239491 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.239625 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.239810 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.240103 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.240238 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.240535 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.240706 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.240882 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.241218 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.241480 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.241743 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.242084 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.242239 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.242650 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.242774 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.243111 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.243404 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.243556 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.243748 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.243956 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.244129 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.244383 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.244551 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.244708 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.244996 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.245146 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.245323 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.245622 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.245785 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.245963 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.246248 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.246419 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.246695 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.246844 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.247000 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.247318 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.247463 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.247640 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.247918 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.248068 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.248510 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.248666 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.248948 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.249108 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.249260 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.249570 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.249672 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.249879 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.250229 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.250339 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.250537 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.250844 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.250944 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.251156 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.251443 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.251543 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.251760 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252035 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252129 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252378 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252602 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252688 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.252990 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.253763 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.253944 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.254275 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.254557 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.254645 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.254892 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.255104 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.255217 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.255528 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.255613 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.255833 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.256137 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.256222 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.256441 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.256692 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.256779 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.257074 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.257241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.257395 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.257727 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.257817 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.258078 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.258388 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.258489 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.258721 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.258986 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.259123 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.259353 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.259545 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.259669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.259993 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.260116 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.260298 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.260602 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.260695 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.260912 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.261216 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.261302 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.261519 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.261786 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.261880 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.262149 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.262400 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.262488 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.262740 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.262969 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.263063 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.263615 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.263700 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.264053 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.264208 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.264417 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.264758 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.264857 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.265090 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.265364 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.265470 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.265718 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.265962 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.266095 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.266415 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.266562 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.266778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.267106 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.267196 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.267437 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.267714 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.267820 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.268100 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.268313 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.268453 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.268819 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.268906 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.269174 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.269395 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.269660 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271340 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271434 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271517 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271596 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271696 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271779 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271884 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.271999 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272090 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272346 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272429 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272508 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272587 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272666 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272666 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272820 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272899 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.272977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273055 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273179 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273302 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273495 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273632 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273817 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.273964 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274159 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274278 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274477 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274589 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274790 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.274885 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275103 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275211 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275418 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275507 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275733 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.275820 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276061 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276368 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276476 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276673 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.276998 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.277088 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.277307 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.277408 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.277619 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.277713 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278331 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278452 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278558 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278642 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278642 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278798 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278884 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.278963 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279197 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279504 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279593 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279814 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.279945 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280277 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280394 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280486 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280575 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280749 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.280839 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281058 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281145 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281366 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281455 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281674 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.281809 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.282006 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.282320 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.282416 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.282630 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.282953 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.283040 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.283284 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.283513 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.283601 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.283902 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.284073 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.284213 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.284525 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.284682 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285009 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285109 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285429 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285675 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.285770 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286022 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286114 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286349 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286436 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286663 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.286914 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.287074 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.287328 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.287532 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.287795 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.288080 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.288186 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.288426 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.288642 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.288737 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.289049 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.289215 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.289365 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.289681 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.289774 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.290025 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.290348 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.290486 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.290673 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.290927 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.291026 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.291345 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.291484 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.291687 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.292005 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.292092 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.292439 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.292603 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.292702 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.293445 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.293550 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294367 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294367 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294543 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294698 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294763 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.294964 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295203 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295302 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295548 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295636 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295877 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.295991 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.296229 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297151 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297151 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297307 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297471 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297560 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.297797 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.298515 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.298673 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.298793 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.299007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.299154 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.299397 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.299610 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.300441 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.301015 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.301611 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.302252 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.302430 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.302581 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.302782 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.302941 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.303361 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.303612 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.303919 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.304090 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.304508 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.304665 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.304822 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.305045 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.305194 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.305496 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.305661 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.305817 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.306182 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.306553 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.306758 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.306906 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.307205 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.307351 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.307522 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.307867 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.308213 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.308429 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.308581 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.308861 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.309009 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.309172 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.309491 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.309642 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.309789 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.310034 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.310554 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.310895 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.311221 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.311757 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.312091 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.312461 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.312803 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.313122 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.313437 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.313879 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.314459 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.314958 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.315469 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.316758 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.316863 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.317127 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.317228 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.317455 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.317561 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.318104 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.318450 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.318813 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.319163 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.319603 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.319844 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.320156 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.320466 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.320795 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.321112 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.321209 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.321435 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.321618 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.321737 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322022 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322119 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322376 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322468 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322692 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.322781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323004 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323101 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323316 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323405 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323628 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323763 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.323939 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324042 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324250 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324339 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324560 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324650 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324870 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.324974 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.325187 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.325289 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.325528 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.325627 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.325845 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326012 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326187 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326282 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326500 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326605 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326820 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.326995 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.327152 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.327557 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.327661 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.327903 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.328041 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.328219 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.328523 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.328643 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.328974 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329075 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329285 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329373 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329724 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329817 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.329991 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330079 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330224 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330375 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330543 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330808 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.330899 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331125 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331217 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331465 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331554 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331790 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.331876 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332099 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332195 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332412 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332499 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332732 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.332819 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333043 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333134 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333369 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333465 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333677 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.333773 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334027 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334122 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334345 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334434 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334673 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334774 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.334990 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335079 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335296 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335404 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335598 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335696 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335902 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.335991 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.336209 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.336497 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.336592 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.336818 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.336906 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337121 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337209 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337421 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337522 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337727 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.337816 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338059 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338149 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338363 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338462 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338666 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338753 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.338966 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339054 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339271 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339367 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339570 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339671 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339870 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.339957 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340171 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340275 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340471 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340560 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340770 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.340857 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341067 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341156 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341367 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341445 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341668 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341768 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.341990 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342084 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342291 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342379 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342590 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342680 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.342984 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343218 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343315 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343545 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343644 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343854 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.343951 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344172 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344260 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344476 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344571 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344794 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.344882 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345100 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345412 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345521 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345722 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.345812 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.346059 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.346161 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.346367 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.346464 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.346697 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.347289 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.347538 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.347670 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.347840 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.347931 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348146 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348270 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348454 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348765 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.348890 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349073 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349213 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349399 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349525 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349720 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.349850 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350048 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350231 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350358 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350505 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350685 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350845 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.350993 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.351137 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.351348 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.351514 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.351717 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.351870 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352014 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352155 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352318 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352489 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352631 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352776 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352893 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.352978 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353071 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353284 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353381 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353597 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353687 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.353935 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354040 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354255 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354571 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354669 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.354884 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.355460 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.355556 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.355781 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.356043 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.356131 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.356398 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.356615 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.356709 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357049 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357136 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357357 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357463 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357692 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.357857 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358036 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358185 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358336 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358515 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358745 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.358887 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.359044 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.359191 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.359344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:30:58.359508 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.359508 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.359826 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.360141 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.360449 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.360758 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.361062 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.361368 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.361672 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.362033 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.362373 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.363241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.363574 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.363893 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.364216 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.364573 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.365154 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.365746 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.366379 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.366962 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.367574 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.367983 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.368309 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.368631 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.368953 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.369273 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.369593 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.369960 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.370284 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.370602 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.370935 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.371260 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.371586 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.371908 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.372223 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.372558 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.372875 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.373190 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.373504 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.373819 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.374166 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.374486 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.374800 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.375111 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.375429 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.375748 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.376079 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.376407 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.376720 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.377051 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.377378 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.377727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.378091 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.378438 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.378768 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.379088 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.379401 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.379708 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:30:58.379957 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:30:58.511838 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO dbcounter [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Registered counter for database nova_api Jul 25 12:30:58.532259 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO dbcounter [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Registered counter for database nova_api Jul 25 12:30:58.532476 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_db.sqlalchemy.engines [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.539404 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writer thread running {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.553006 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_db.sqlalchemy.engines [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.559442 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writer thread running {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.594216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.context [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fa515c24-2446-4072-8c71-57a58390eeef(cell1) {{(pid=104937) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:30:58.598671 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_concurrency.lockutils [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:30:58.600240 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_concurrency.lockutils [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:30:58.601016 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_concurrency.lockutils [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:30:58.602995 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_concurrency.lockutils [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:30:58.604933 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO dbcounter [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Registered counter for database nova_cell0 Jul 25 12:30:58.610438 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO dbcounter [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Registered counter for database nova_cell1 Jul 25 12:30:58.615265 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.context [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fa515c24-2446-4072-8c71-57a58390eeef(cell1) {{(pid=104938) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:30:58.618057 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_db.sqlalchemy.engines [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.619323 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:30:58.620233 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_db.sqlalchemy.engines [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.620921 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:30:58.621717 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:30:58.623733 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:30:58.625111 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writer thread running {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.625739 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO dbcounter [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Registered counter for database nova_cell0 Jul 25 12:30:58.627809 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writer thread running {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.631264 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO dbcounter [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Registered counter for database nova_cell1 Jul 25 12:30:58.638015 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_db.sqlalchemy.engines [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.639687 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_db.sqlalchemy.engines [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.645534 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writer thread running {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.647758 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writer thread running {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.774892 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO dbcounter [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Registered counter for database nova_cell0 Jul 25 12:30:58.783905 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG oslo_db.sqlalchemy.engines [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.789295 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writer thread running {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:58.795625 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO dbcounter [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Registered counter for database nova_cell0 Jul 25 12:30:58.805225 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_db.sqlalchemy.engines [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:30:58.809678 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writer thread running {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:30:59.128521 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: WARNING keystonemiddleware.auth_token [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:30:59.131045 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: WARNING keystonemiddleware.auth_token [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:30:59.135956 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: WARNING keystonemiddleware.auth_token [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:30:59.138430 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: WARNING keystonemiddleware.auth_token [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:30:59.479693 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: WARNING keystonemiddleware.auth_token [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:30:59.483844 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: WARNING keystonemiddleware.auth_token [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:30:59.485848 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: WARNING keystonemiddleware.auth_token [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:30:59.490375 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: WARNING keystonemiddleware.auth_token [None req-906eeab5-15e2-40a9-9a27-2b1a728d9cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:30:59.491674 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e718d889c0 pid: 104938 (default app) Jul 25 12:30:59.493759 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:30:59.494986 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Jul 25 12:30:59.495407 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Mon Jul 25 12:30:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:30:59.495616 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e718d889c0 pid: 104937 (default app) Jul 25 12:32:15.177151 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:15.178174 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 25 12:32:15.178575 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:15.196202 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_api:SELECT=3 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.197700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_cell1:SELECT=3 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.198785 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_cell0:SELECT=3 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.199838 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:16.095718 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-58a0aa1b-3af1-4c93-b202-6ece9fe0e4db admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:16.129376 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-58a0aa1b-3af1-4c93-b202-6ece9fe0e4db admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.942498 Jul 25 12:32:16.130302 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Mon Jul 25 12:32:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:32:18.362524 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:18.364056 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-07d349e0-efaf-4f2c-8d10-fcea77ab2564 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Jul 25 12:32:18.364618 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:18.838501 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-cb33d688-d84d-4ae4-84bb-7854b2396e57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:18.859884 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:32:18.859884 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: warnings.warn(msg) Jul 25 12:32:18.889713 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-cb33d688-d84d-4ae4-84bb-7854b2396e57 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518841 Jul 25 12:32:18.898128 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:19.114916 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-13c02f4c-992e-4241-bd87-a944d3055ede admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:19.119270 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:32:19.119270 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:32:19.121941 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_api:SELECT=3 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:19.122752 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_cell0:SELECT=3 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:19.123675 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_cell1:SELECT=3 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:19.125530 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_cell0:SELECT=3 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:19.194841 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-13c02f4c-992e-4241-bd87-a944d3055ede admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294904 Jul 25 12:32:19.205881 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Mon Jul 25 12:32:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:32:21.427330 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-cb33d688-d84d-4ae4-84bb-7854b2396e57 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:21.428432 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-cb33d688-d84d-4ae4-84bb-7854b2396e57 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jul 25 12:32:21.428919 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:22.165501 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-cd67853e-58cd-4a71-a900-9895bfc78e2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:22.204110 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:32:22.204110 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:32:22.231977 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-cd67853e-58cd-4a71-a900-9895bfc78e2e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.796961 Jul 25 12:32:22.233234 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:22.247801 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8d7a597f-d866-4601-9321-89de87b95abd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:22.255124 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:32:22.255124 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: warnings.warn(msg) Jul 25 12:32:22.304406 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8d7a597f-d866-4601-9321-89de87b95abd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062406 Jul 25 12:32:22.305238 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Mon Jul 25 12:32:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:24.615392 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-cd67853e-58cd-4a71-a900-9895bfc78e2e admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:24.616739 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-cd67853e-58cd-4a71-a900-9895bfc78e2e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 12:32:24.622204 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:24 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:25.148667 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-cc4a3286-9e92-4d14-996b-ba1d07ab033e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:25.173565 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-cc4a3286-9e92-4d14-996b-ba1d07ab033e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550923 Jul 25 12:32:25.174480 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:25.190355 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-70d16a4f-fbc9-4953-86d8-5607a66dc32a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:25.218799 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-70d16a4f-fbc9-4953-86d8-5607a66dc32a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035233 Jul 25 12:32:25.220559 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Mon Jul 25 12:32:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:27.519091 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-cc4a3286-9e92-4d14-996b-ba1d07ab033e admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:27.520111 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-cc4a3286-9e92-4d14-996b-ba1d07ab033e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 25 12:32:27.520522 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:28.012195 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-110ce8d7-03dc-4409-93fa-5b5ec2e4f819 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:28.044660 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-110ce8d7-03dc-4409-93fa-5b5ec2e4f819 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518266 Jul 25 12:32:28.047953 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:28.063154 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-400cef96-0589-41be-9d6c-25941fe3cbb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:28.092142 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-400cef96-0589-41be-9d6c-25941fe3cbb6 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037254 Jul 25 12:32:28.092887 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Mon Jul 25 12:32:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:32:30.362330 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-110ce8d7-03dc-4409-93fa-5b5ec2e4f819 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:30.363327 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-110ce8d7-03dc-4409-93fa-5b5ec2e4f819 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 25 12:32:30.363899 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:31.041142 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "disk": 20}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:31.086787 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716776 Jul 25 12:32:31.087768 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:31.102492 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-8a4b4fcc-7ce4-4814-aaea-3009544e3eca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:31.194767 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-8a4b4fcc-7ce4-4814-aaea-3009544e3eca admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094982 Jul 25 12:32:31.202258 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Mon Jul 25 12:32:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:33.482876 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:33.484453 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 25 12:32:33.484848 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:34.037692 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-615a0c19-0343-48d5-bf15-ecc2ac9196f0 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:34.064332 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-615a0c19-0343-48d5-bf15-ecc2ac9196f0 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.573407 Jul 25 12:32:34.064901 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Mon Jul 25 12:32:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:32:36.357125 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:36.358865 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-7f447bdc-8fdf-440d-884e-08f1b4b0f880 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 Jul 25 12:32:36.359421 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:36.853802 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-f7b5ef72-c59a-41d3-a527-b23103c3ed50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:36.873356 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-f7b5ef72-c59a-41d3-a527-b23103c3ed50 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506201 Jul 25 12:32:36.874493 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:36.886871 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-31e94f10-44de-4ed9-894b-3e66a43f6083 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:36.910680 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-31e94f10-44de-4ed9-894b-3e66a43f6083 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027463 Jul 25 12:32:36.911357 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Mon Jul 25 12:32:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:32:39.393847 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-f7b5ef72-c59a-41d3-a527-b23103c3ed50 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:39.394904 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-f7b5ef72-c59a-41d3-a527-b23103c3ed50 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 25 12:32:39.395305 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:39.782293 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-64e6f6e0-7271-4a2a-8cf7-f650009fda66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:39.801200 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-64e6f6e0-7271-4a2a-8cf7-f650009fda66 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.399935 Jul 25 12:32:39.802365 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:39.813937 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-899686dd-2c60-41e1-8c1e-0ad7a158f843 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:39.836896 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-899686dd-2c60-41e1-8c1e-0ad7a158f843 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026659 Jul 25 12:32:39.837464 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Mon Jul 25 12:32:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:42.019280 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-64e6f6e0-7271-4a2a-8cf7-f650009fda66 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:42.020292 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-64e6f6e0-7271-4a2a-8cf7-f650009fda66 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 25 12:32:42.020717 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:42.415807 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e468cc5b-ee6d-415c-ae25-09b9734e849c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:42.440172 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-e468cc5b-ee6d-415c-ae25-09b9734e849c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.413322 Jul 25 12:32:42.440990 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:42.454987 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-78cdef32-8337-4fb2-b95b-5246be72821d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:42.481723 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-78cdef32-8337-4fb2-b95b-5246be72821d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032048 Jul 25 12:32:42.490088 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Mon Jul 25 12:32:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:44.701541 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e468cc5b-ee6d-415c-ae25-09b9734e849c admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:44.702718 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-e468cc5b-ee6d-415c-ae25-09b9734e849c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jul 25 12:32:44.703383 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:45.138100 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1a691733-392b-47eb-9746-c04d486a8045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:45.158404 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1a691733-392b-47eb-9746-c04d486a8045 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.449542 Jul 25 12:32:45.159370 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:45.173681 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-86f18b23-cc0a-41f1-b2e8-fab6d1dd2618 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:45.197767 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-86f18b23-cc0a-41f1-b2e8-fab6d1dd2618 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028260 Jul 25 12:32:45.198383 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Mon Jul 25 12:32:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:32:47.422969 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1a691733-392b-47eb-9746-c04d486a8045 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:32:47.424772 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1a691733-392b-47eb-9746-c04d486a8045 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002272 Jul 25 12:32:47.425176 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:32:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:32:47.920724 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "id": "5"}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:47.940136 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.509035 Jul 25 12:32:47.941036 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Mon Jul 25 12:32:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:47.953974 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-5a8321e1-c3a8-4b06-af27-3b3de880512b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:32:47.960113 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:47.985778 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-5a8321e1-c3a8-4b06-af27-3b3de880512b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036582 Jul 25 12:32:47.986398 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Mon Jul 25 12:32:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:33:07.310855 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:07.311855 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002070 Jul 25 12:33:07.312250 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:33:07.322515 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:07.697208 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-cf3f2199-dc9a-4edc-93ed-b8ff8548d49c admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:07.715301 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-cf3f2199-dc9a-4edc-93ed-b8ff8548d49c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397207 Jul 25 12:33:07.715832 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Mon Jul 25 12:33:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:33:08.777957 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:08.779582 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-500d26f8-b65a-42a9-8137-60ed77200ab5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 25 12:33:08.779980 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:09.296499 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-d4b654b1-c6fd-4c7e-99f4-83f842208562 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:09.302125 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.wsgi [None req-d4b654b1-c6fd-4c7e-99f4-83f842208562 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-d4b654b1-c6fd-4c7e-99f4-83f842208562 admin admin] Request method failure captured: Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept: application/json Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept-Encoding: gzip, deflate Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Connection: keep-alive Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Content-Length: 0 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Host: 10.222.0.60 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-System-Scope: None Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: User-Agent: python-novaclient Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Auth-Token: gAAAAABi3o2E0RfgfKoxrvzAzcTlpXBOAGRN5_p2dfbEtoiujo_VaDxiJGKMAalyXTLt3WbZZ6kUlPt1b2mN5vjvhjyDErMhaB45MJbIA5pisbbu48NqRJwhB5s0KZ3GCPc3Wg83XtYd90xFtWVyYtL4KKvVo0FbUXqGEwnW2gLpsSxofSjJ3YQ Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Id: None Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Name: None Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Identity-Status: Confirmed Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Is-Admin-Project: True Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Id: default Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Name: Default Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Name: admin Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Role: admin,member,reader Jul 25 12:33:09.305327 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Roles: admin,member,reader Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant: admin Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Name: admin Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User: admin Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Id: default Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Name: Default Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Name: admin Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: method: > Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: exception: Flavor 42 could not be found. Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: action_args: {'id': '42'} Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:09.306799 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:09.307700 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.309007 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-d4b654b1-c6fd-4c7e-99f4-83f842208562 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:09.310976 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-d4b654b1-c6fd-4c7e-99f4-83f842208562 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.385286 Jul 25 12:33:09.310976 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Jul 25 12:33:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:33:09.316893 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-9cf5d835-cea8-464e-870d-86200e73e13b admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:09.320935 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:09.339964 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-9cf5d835-cea8-464e-870d-86200e73e13b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026608 Jul 25 12:33:09.340482 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:33:09.349940 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-029e88af-0c19-418a-8d6f-443ee11c4a2c admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:09.374563 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-029e88af-0c19-418a-8d6f-443ee11c4a2c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028117 Jul 25 12:33:09.375085 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:33:09.384208 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-4c3807ec-86b8-4140-a22c-51532d3cc4d8 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:09.390457 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.wsgi [None req-4c3807ec-86b8-4140-a22c-51532d3cc4d8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-4c3807ec-86b8-4140-a22c-51532d3cc4d8 admin admin] Request method failure captured: Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept: application/json Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept-Encoding: gzip, deflate Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Connection: keep-alive Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Content-Length: 0 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Host: 10.222.0.60 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-System-Scope: None Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: User-Agent: python-novaclient Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Auth-Token: gAAAAABi3o2E0RfgfKoxrvzAzcTlpXBOAGRN5_p2dfbEtoiujo_VaDxiJGKMAalyXTLt3WbZZ6kUlPt1b2mN5vjvhjyDErMhaB45MJbIA5pisbbu48NqRJwhB5s0KZ3GCPc3Wg83XtYd90xFtWVyYtL4KKvVo0FbUXqGEwnW2gLpsSxofSjJ3YQ Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Id: None Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Name: None Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Identity-Status: Confirmed Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Is-Admin-Project: True Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Id: default Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Name: Default Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Name: admin Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Role: admin,member,reader Jul 25 12:33:09.393629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Roles: admin,member,reader Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant: admin Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Name: admin Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User: admin Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Id: default Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Name: Default Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Name: admin Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: method: > Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: exception: Flavor 42 could not be found. Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: action_args: {'id': '42'} Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:09.395140 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:09.396122 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:09.397181 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-4c3807ec-86b8-4140-a22c-51532d3cc4d8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:09.398231 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-4c3807ec-86b8-4140-a22c-51532d3cc4d8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014350 Jul 25 12:33:09.398231 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Jul 25 12:33:09 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 25 12:33:10.354456 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-029e88af-0c19-418a-8d6f-443ee11c4a2c admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:10.355468 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-029e88af-0c19-418a-8d6f-443ee11c4a2c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Jul 25 12:33:10.355869 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:10.884274 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e22a459d-f64e-4b7f-9ea1-54c95b7292c9 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:10.890759 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.wsgi [None req-e22a459d-f64e-4b7f-9ea1-54c95b7292c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e22a459d-f64e-4b7f-9ea1-54c95b7292c9 admin admin] Request method failure captured: Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept: application/json Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept-Encoding: gzip, deflate Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Connection: keep-alive Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Content-Length: 0 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Host: 10.222.0.60 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-System-Scope: None Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: User-Agent: python-novaclient Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Auth-Token: gAAAAABi3o2GCqfNX3rFWhNRkSFxJ1-QG_tuj9OZXoocKl3I-traUx0k8lPnqdfzKvR3ahYwA5zDnJ1NK5Mwni1X6kQunbacag8s6jPssF2TTKQFpJXikidaBSy9YwYL-LZrXwikBOiXNMAYKlnMbvq-gSPcyQpd39IRmi8_E_JMfgy8OlKVZ_8 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Id: None Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Name: None Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Identity-Status: Confirmed Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Is-Admin-Project: True Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Id: default Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Name: Default Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Name: admin Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Role: admin,member,reader Jul 25 12:33:10.892241 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Roles: admin,member,reader Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant: admin Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Name: admin Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User: admin Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Id: default Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Name: Default Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Name: admin Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: method: > Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: exception: Flavor 84 could not be found. Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: action_args: {'id': '84'} Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:10.893781 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:10.894782 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.896159 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e22a459d-f64e-4b7f-9ea1-54c95b7292c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:10.897534 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-e22a459d-f64e-4b7f-9ea1-54c95b7292c9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.402529 Jul 25 12:33:10.897534 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Jul 25 12:33:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:33:10.903055 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-13559b10-b661-4a05-ac0f-fe2d98fd121c admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:10.918187 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-13559b10-b661-4a05-ac0f-fe2d98fd121c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018555 Jul 25 12:33:10.918694 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:33:10.927639 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-28aef9a8-888c-479a-a1ad-9ba2ab4589c2 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:10.943837 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-28aef9a8-888c-479a-a1ad-9ba2ab4589c2 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019570 Jul 25 12:33:10.944375 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:33:10.953904 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8807be19-1365-4be0-9306-87a02ed0f8fd admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:10.959162 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.wsgi [None req-8807be19-1365-4be0-9306-87a02ed0f8fd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8807be19-1365-4be0-9306-87a02ed0f8fd admin admin] Request method failure captured: Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept: application/json Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept-Encoding: gzip, deflate Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Connection: keep-alive Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Content-Length: 0 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Host: 10.222.0.60 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-System-Scope: None Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: User-Agent: python-novaclient Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Auth-Token: gAAAAABi3o2GCqfNX3rFWhNRkSFxJ1-QG_tuj9OZXoocKl3I-traUx0k8lPnqdfzKvR3ahYwA5zDnJ1NK5Mwni1X6kQunbacag8s6jPssF2TTKQFpJXikidaBSy9YwYL-LZrXwikBOiXNMAYKlnMbvq-gSPcyQpd39IRmi8_E_JMfgy8OlKVZ_8 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Id: None Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Name: None Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Identity-Status: Confirmed Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Is-Admin-Project: True Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Id: default Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Name: Default Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Name: admin Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Role: admin,member,reader Jul 25 12:33:10.960669 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Roles: admin,member,reader Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant: admin Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Name: admin Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User: admin Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Id: default Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Name: Default Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Name: admin Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: method: > Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: exception: Flavor 84 could not be found. Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: action_args: {'id': '84'} Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:10.962175 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:10.963216 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:10.964580 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8807be19-1365-4be0-9306-87a02ed0f8fd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:10.965785 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8807be19-1365-4be0-9306-87a02ed0f8fd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012110 Jul 25 12:33:10.965785 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Mon Jul 25 12:33:10 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:33:11.913586 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-28aef9a8-888c-479a-a1ad-9ba2ab4589c2 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:11.914632 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-28aef9a8-888c-479a-a1ad-9ba2ab4589c2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 25 12:33:11.915026 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:12.440212 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-6f5970a6-b033-419a-a8a9-0e883b915e34 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:12.445828 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.wsgi [None req-6f5970a6-b033-419a-a8a9-0e883b915e34 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-6f5970a6-b033-419a-a8a9-0e883b915e34 admin admin] Request method failure captured: Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept: application/json Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Accept-Encoding: gzip, deflate Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Connection: keep-alive Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Content-Length: 0 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Host: 10.222.0.60 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Openstack-System-Scope: None Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: User-Agent: python-novaclient Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Auth-Token: gAAAAABi3o2H_csHCxGqEzEHk_gjBZpZphLQctM_Bn5beUVO3mao8rIBWjGgV7lM-DuicDj4T-wMQ3VkDdB9dK72YwCAZBs0cDmvrzbyZ0Uw9oedUR3y0lw3LWlkYM4nbU5GsRZ9uWeLgz3RcV4qwgMl01QJ1mAMrQN9E9ZYaaK6GenmetxPhtQ Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Id: None Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Domain-Name: None Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Identity-Status: Confirmed Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Is-Admin-Project: True Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Id: default Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Domain-Name: Default Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Project-Name: admin Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Role: admin,member,reader Jul 25 12:33:12.447344 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Roles: admin,member,reader Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant: admin Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-Tenant-Name: admin Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User: admin Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Id: default Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Domain-Name: Default Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: X-User-Name: admin Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: method: > Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: exception: Flavor 451 could not be found. Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: action_args: {'id': '451'} Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:12.448888 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:12.449846 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.450977 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-6f5970a6-b033-419a-a8a9-0e883b915e34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:12.452053 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-6f5970a6-b033-419a-a8a9-0e883b915e34 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394671 Jul 25 12:33:12.452053 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:33:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:33:12.458385 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-b8fcbca3-a968-48cd-ba0e-8576aba98284 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:12.473106 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-b8fcbca3-a968-48cd-ba0e-8576aba98284 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018228 Jul 25 12:33:12.473629 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:33:12.483647 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:12.498911 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019273 Jul 25 12:33:12.499440 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Mon Jul 25 12:33:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:33:12.508339 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-2ac8f80d-7afe-4504-9e74-b95bd493b7d9 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:12.513430 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.wsgi [None req-2ac8f80d-7afe-4504-9e74-b95bd493b7d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-2ac8f80d-7afe-4504-9e74-b95bd493b7d9 admin admin] Request method failure captured: Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept: application/json Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Accept-Encoding: gzip, deflate Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Connection: keep-alive Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Content-Length: 0 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Host: 10.222.0.60 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-Api-Version: compute 2.90 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Openstack-System-Scope: None Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: User-Agent: python-novaclient Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Auth-Token: gAAAAABi3o2H_csHCxGqEzEHk_gjBZpZphLQctM_Bn5beUVO3mao8rIBWjGgV7lM-DuicDj4T-wMQ3VkDdB9dK72YwCAZBs0cDmvrzbyZ0Uw9oedUR3y0lw3LWlkYM4nbU5GsRZ9uWeLgz3RcV4qwgMl01QJ1mAMrQN9E9ZYaaK6GenmetxPhtQ Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Id: None Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Domain-Name: None Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Identity-Status: Confirmed Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Is-Admin-Project: True Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Id: default Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Domain-Name: Default Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Project-Name: admin Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Role: admin,member,reader Jul 25 12:33:12.514936 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Roles: admin,member,reader Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_61157336119141239b389248fadfbdf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/61157336119141239b389248fadfbdf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/61157336119141239b389248fadfbdf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant: admin Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Id: 61157336119141239b389248fadfbdf0 Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-Tenant-Name: admin Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User: admin Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Id: default Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Domain-Name: Default Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Id: 6bca01c7266944329ecb3cbe0887bc8e Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: X-User-Name: admin Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: method: > Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: exception: Flavor 451 could not be found. Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: action_args: {'id': '451'} Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:33:12.516591 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:12.517565 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: ERROR nova.api.openstack.wsgi Jul 25 12:33:12.518727 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-2ac8f80d-7afe-4504-9e74-b95bd493b7d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104938) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:33:12.519762 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-2ac8f80d-7afe-4504-9e74-b95bd493b7d9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011390 Jul 25 12:33:12.519762 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:33:12 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 12:33:13.473442 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:13.474474 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 25 12:33:13.474880 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:13.990321 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-a3313250-08bb-44f6-912f-f85024064ca3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:33:14.018024 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-a3313250-08bb-44f6-912f-f85024064ca3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405673 Jul 25 12:33:14.018513 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Jul 25 12:33:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:33:14.981046 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:14.982689 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Jul 25 12:33:14.983074 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:15.496479 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-ae588caa-33e1-4f45-aba0-6f0228204525 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:33:15.514722 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-ae588caa-33e1-4f45-aba0-6f0228204525 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.394362 Jul 25 12:33:15.515243 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Jul 25 12:33:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:33:16.477163 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:16.478223 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 25 12:33:16.478874 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:16.998788 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-9c67efa0-ff9e-4c0e-9d42-77d8c9ca294c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:33:17.017192 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-9c67efa0-ff9e-4c0e-9d42-77d8c9ca294c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400269 Jul 25 12:33:17.017737 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Jul 25 12:33:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:33:17.978451 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:17.979730 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Jul 25 12:33:17.980124 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:18.495401 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-c61b960b-ea8f-4850-ba76-4a0bfcff4f40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:33:18.513445 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-c61b960b-ea8f-4850-ba76-4a0bfcff4f40 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.393767 Jul 25 12:33:18.513991 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Mon Jul 25 12:33:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:33:19.477653 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:19.478951 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 25 12:33:19.479347 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:33:20.004063 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-b3c8d94e-421d-41cc-bad3-fe4732961fea admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:33:20.026785 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-b3c8d94e-421d-41cc-bad3-fe4732961fea admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407974 Jul 25 12:33:20.027329 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Mon Jul 25 12:33:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:34:10.993740 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:10.994839 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-8e58ff48-8289-45be-9db8-5951de2f5288 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 25 12:34:10.995228 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Mon Jul 25 12:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:34:11.006105 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:11.381813 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-9c3bf7c5-0547-4b39-97c2-77b6e3713e2d admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:11.401567 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-9c3bf7c5-0547-4b39-97c2-77b6e3713e2d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399967 Jul 25 12:34:11.402135 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Mon Jul 25 12:34:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:34:11.426149 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-e35ef28c-3c3b-4348-9490-c8fdc5cf92da admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:11.429575 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG dbcounter [-] [104937] Writing DB stats nova_api:SELECT=14 {{(pid=104937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:11.435422 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-e35ef28c-3c3b-4348-9490-c8fdc5cf92da admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012874 Jul 25 12:34:11.435945 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Mon Jul 25 12:34:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:34:11.447275 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-c614e8a6-ee5d-4da2-b77f-7b61df2447ff admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:11.455378 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-c614e8a6-ee5d-4da2-b77f-7b61df2447ff admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011620 Jul 25 12:34:11.455889 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Mon Jul 25 12:34:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:34:11.467287 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:11.474628 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 Jul 25 12:34:11.475135 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Mon Jul 25 12:34:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:34:11.486237 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e82f0b00-3e88-45da-a1e1-02fbd69d64bf admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:34:11.493555 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-e82f0b00-3e88-45da-a1e1-02fbd69d64bf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010701 Jul 25 12:34:11.494100 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Mon Jul 25 12:34:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:37:28.327201 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:28.328220 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 25 12:37:28.328618 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:28.471676 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_api:SELECT=6 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:28.628229 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:28.630579 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:28.630579 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:37:28.631791 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:28.632286 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:28.633142 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:28.633572 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:28.667695 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-ba7df065-8c9f-4da5-a78e-0e3fa08c3d62 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.197492 Jul 25 12:37:28.668251 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:37:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:37:29.489146 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:29.490213 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 25 12:37:29.490613 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:29.679643 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:29.682085 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:29.682085 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:37:29.683303 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:29.683742 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:29.684527 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:29.684950 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:29.704888 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-2331abe7-dbc4-4184-997b-f23b00688401 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076183 Jul 25 12:37:29.705366 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:37:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:37:40.929252 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:40.930292 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 25 12:37:40.930690 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:41.074740 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_cell0:SELECT=4 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:41.075458 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_cell1:SELECT=4 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:41.076056 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG dbcounter [-] [104938] Writing DB stats nova_api:SELECT=8 {{(pid=104938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:37:41.125550 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:41.127917 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:41.127917 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:37:41.129106 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:41.129549 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:41.130372 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:41.130801 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:41.154970 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-e2c7966d-a86d-48ea-aeae-94c2bc5a9536 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084698 Jul 25 12:37:41.155752 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:37:41 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:37:41.993122 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: DEBUG nova.api.openstack.wsgi [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] Calling method '>' {{(pid=104937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:41.994165 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: INFO nova.api.openstack.requestlog [None req-1e6b2f55-2c62-4ffa-a5c0-bb479d3c3ba4 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 25 12:37:41.994568 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: [pid: 104937|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Mon Jul 25 12:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:37:42.187910 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG nova.api.openstack.wsgi [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] Calling method '>' {{(pid=104938) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:37:42.190362 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:37:42.190362 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: warnings.warn(msg) Jul 25 12:37:42.191580 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:42.192032 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:42.192805 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:37:42.193225 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: DEBUG oslo_concurrency.lockutils [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104938) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:37:42.214671 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: INFO nova.api.openstack.requestlog [None req-21f97bf7-1c8c-407a-8a1b-464ec870e8cd admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078639 Jul 25 12:37:42.215146 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: [pid: 104938|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Mon Jul 25 12:37:42 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:38:37.915974 dv-cinder-825492-28-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 12:38:37.916741 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: Mon Jul 25 12:38:37 2022 - graceful shutdown triggered... Jul 25 12:38:37.917212 dv-cinder-825492-28-iscsi devstack@n-api.service[104937]: Gracefully killing worker 1 (pid: 104937)... Jul 25 12:38:37.917581 dv-cinder-825492-28-iscsi devstack@n-api.service[104938]: Gracefully killing worker 2 (pid: 104938)... Jul 25 12:38:38.917389 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: worker 1 buried after 1 seconds Jul 25 12:38:38.917974 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: worker 2 buried after 1 seconds Jul 25 12:38:38.917974 dv-cinder-825492-28-iscsi devstack@n-api.service[104936]: goodbye to uWSGI. Jul 25 12:38:38.919040 dv-cinder-825492-28-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 12:38:38.919586 dv-cinder-825492-28-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 12:38:38.923139 dv-cinder-825492-28-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 12:38:38.931950 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 12:38:38.934526 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:38:38 2022] *** Jul 25 12:38:38.934694 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:38:38.934826 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:38:38.934947 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: nodename: dv-cinder-825492-28-iscsi Jul 25 12:38:38.935057 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: machine: x86_64 Jul 25 12:38:38.935173 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: clock source: unix Jul 25 12:38:38.935281 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: pcre jit disabled Jul 25 12:38:38.935388 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: detected number of CPU cores: 4 Jul 25 12:38:38.935495 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: current working directory: / Jul 25 12:38:38.935603 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:38:38.935728 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: your processes number limit is 47680 Jul 25 12:38:38.935861 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: your memory page size is 4096 bytes Jul 25 12:38:38.935861 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: detected max file descriptor number: 2048 Jul 25 12:38:38.935861 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: lock engine: pthread robust mutexes Jul 25 12:38:38.936115 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: thunder lock: enabled Jul 25 12:38:38.936214 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 12:38:38.936426 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:38:38.975298 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: Python main interpreter initialized at 0x5570d32269c0 Jul 25 12:38:38.975298 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: python threads support enabled Jul 25 12:38:38.975298 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: your server socket listen backlog is limited to 100 connections Jul 25 12:38:38.975298 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:38:38.975698 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:38:38.975698 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: *** Operational MODE: preforking *** Jul 25 12:38:38.975971 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:38:38.975971 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: spawned uWSGI master process (pid: 129804) Jul 25 12:38:38.976172 dv-cinder-825492-28-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 12:38:38.990581 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: spawned uWSGI worker 1 (pid: 129815, cores: 1) Jul 25 12:38:38.990581 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: spawned uWSGI worker 2 (pid: 129816, cores: 1) Jul 25 12:38:38.990581 dv-cinder-825492-28-iscsi devstack@n-api.service[129804]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:38:39.654447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:38:39.656390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 12:38:40.812483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:38:40.812483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: from cryptography.utils import int_from_bytes Jul 25 12:38:40.813108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:38:40.813108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: from cryptography.utils import int_from_bytes Jul 25 12:38:40.813269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:38:40.813269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: from cryptography.utils import int_from_bytes Jul 25 12:38:40.813269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:38:40.813269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: from cryptography.utils import int_from_bytes Jul 25 12:38:43.247184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:38:43.247859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:38:43.247984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:38:43.248348 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:38:43.248605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:38:43.248997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.249322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.249642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.249986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.250916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.251228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.251571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.251873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.252200 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.252461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.252775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.253097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-28-iscsi {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.253416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.253876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.254215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.254537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.254846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.255171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.255482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.255985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.257938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.258724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.258724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.258994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.259189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.259593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-28-iscsi {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.259914 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.260228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.260546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.260961 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.261278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.261620 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.261954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.262281 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.262593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.262919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.263233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.263552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.263874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.264178 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.264327 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:38:43.264756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.264892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:38:43.265025 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.265168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.265375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:38:43.265521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.265664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.266469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:38:43.266581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.266805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.266983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:38:43.267126 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.267447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.267600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.267773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268174 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.268909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269297 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.269930 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270267 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.270944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.271905 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-28-iscsi {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272062 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272213 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.272918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273370 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273529 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.273833 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274506 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.274990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275298 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275765 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.275916 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276219 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276834 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.276980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.277891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-28-iscsi {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278381 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278544 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.278861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279376 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.279945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280245 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280391 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.280856 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.281951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282115 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282270 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.282986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283133 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283584 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.283875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.284935 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285594 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.285942 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.286870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287024 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287333 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287492 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287640 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.287946 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.288885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.289980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290146 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290615 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.290932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.291792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292231 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.292936 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293094 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.293859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.294051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.294214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.294371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.294517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.294675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.294844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.295004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.295158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.295357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.295514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.295678 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.295835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.295994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.296147 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.296299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.296444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.296588 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.296754 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.296914 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.297060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.297205 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.297360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.297505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.297665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.297818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.297982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.298143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.298297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.298297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.298590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.298753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.298899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.299043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.299188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.299341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.299499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.299651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.299804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.299970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.300185 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.300336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.300495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.300649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.300804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.300959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.301104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.301263 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.301409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.301562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.301708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.301861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.302052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.302211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.302364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.302510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.302655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.302818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.303059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.303219 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.303366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.303519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.303679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.303826 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.303980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.304134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.304134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.304418 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.304576 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.304730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.304889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.305034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.305180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.305339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.305486 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.305637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.305787 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.306008 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.306164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.306319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.306466 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.306619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.306775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.306928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.307124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.307290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.307438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.307597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.307757 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.307910 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.308056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.308201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.308360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.308512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.308657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.308819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.308971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.309123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.309284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.309436 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.309589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.309742 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.309887 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.310071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.310317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.310480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.310636 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.310789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.310946 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.311105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.311252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.311406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.311559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:38:43.311712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.311869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.312029 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.312187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.312407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.312573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.313314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.313476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.313648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.313804 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.314912 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315524 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.315982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.316965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317732 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.317886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318070 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318388 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.318999 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.319903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320742 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.320898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321704 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.321867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322387 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.322996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.323157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.323328 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.323554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.323730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.323877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324617 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324770 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.324916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325063 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325528 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.325858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326204 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.326960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327413 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.327868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.328012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.328167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.328366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.329978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.330152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.330309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.330486 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.330705 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.330866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331630 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.331936 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332082 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.332860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.333853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334203 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334507 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334507 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334782 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.334928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335704 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.335860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336020 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336328 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336473 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336770 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.336929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337222 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.337853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.338986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339274 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.339912 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340538 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.340931 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341082 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.341840 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342784 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.342937 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343400 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.343969 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344130 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.344893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345207 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.345808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.346993 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347652 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347801 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.347956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.348963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349119 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349578 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349738 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.349885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.350860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351247 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351400 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351706 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.351860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352456 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352625 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.352932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.353832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354191 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.354953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.355867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356316 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356316 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.356900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.357991 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358481 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358642 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.358957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.359108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.359539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.359700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.359853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360804 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.360995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.361236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.361405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.361574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.361728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.361881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.362890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363220 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363379 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363545 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.363858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364475 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364643 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.364958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365281 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.365903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366255 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.366864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367356 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367666 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.367985 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368594 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.368914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369084 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369398 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369557 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.369943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370433 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.370915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371484 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.371968 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372772 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.372926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373720 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.373881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374075 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374231 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.374859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.375019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.375690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.375861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376480 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376640 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.376967 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.377128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.377280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.377440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.377612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.377776 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.378890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.379990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380153 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380306 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380631 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.381214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.381382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.381632 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.381802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.381979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.382926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383572 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.383877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384029 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384182 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.384893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385732 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.385895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.386942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.387890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388215 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.388846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.389957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.390137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.390292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.390445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.390608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.390813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391475 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391794 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.391984 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392174 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392259 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392887 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.392977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.393891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394556 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394831 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.394923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395281 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.395999 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396186 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396630 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396896 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.396980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397238 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397599 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397862 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.397975 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398645 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.398927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399247 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399342 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399437 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.399971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400869 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.400962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401492 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.401816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.402928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403556 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403872 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.403978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.404987 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405756 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.405974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406085 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406767 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.406961 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407063 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.407932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408024 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408865 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.408957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409270 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409552 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.409949 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.410160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.410434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.410576 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.410746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.410902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.411059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.411218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.411372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.411756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412135 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.412880 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413500 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.413808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414270 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414678 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.414985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.415200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.415301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.415511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.415621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.415826 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416119 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.416876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.417830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.418995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419400 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419651 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.419958 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420269 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420362 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.420904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.421009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.421222 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.421315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.421562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.421987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422366 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.422983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.423912 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.424829 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425342 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.425973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426705 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.426925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427237 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.427949 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428155 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428497 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.428932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429135 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429255 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.429889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430246 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430782 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.430884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431095 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.431843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432032 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432424 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432749 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.432945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433341 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.433992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.434214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.434315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.434528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.434749 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.434850 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.435823 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436465 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.436978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.437078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.437292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.437397 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.437607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.438266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.438477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.438577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.438807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.438927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439133 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439776 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.439871 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440103 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440206 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.440838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441055 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441358 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441662 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.441756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442023 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442455 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.442997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443201 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443504 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.443910 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.444877 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445364 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.445994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.446922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447391 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447567 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447790 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.447936 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448587 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448771 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.448917 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.449867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450098 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.450971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451282 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.451924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452601 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.452870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.453060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.453197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.453938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.454258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.454395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.454573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.454719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.454889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455036 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455500 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.455960 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456263 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456576 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.456918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.457867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458690 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.458827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.459948 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460397 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460555 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.460864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461296 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.461906 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462113 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462781 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.462919 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463200 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.463935 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.464871 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465311 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465709 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.465846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466523 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466720 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.466858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467689 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.467834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468481 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.468964 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.469112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.469279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.469415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.469587 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.469733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.470525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.470695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.470835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.470968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471525 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471810 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.471810 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472217 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.472961 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473231 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473663 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.473946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474638 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474770 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.474910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.475907 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476855 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.476999 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.477135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.477268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.477536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.477683 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.477820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478303 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.478868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.479976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480643 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.480916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481191 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.481877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482055 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.482891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483112 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483398 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483663 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.483880 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.484018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.484450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.484613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.484798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.484950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485246 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.485850 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486314 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.486955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487270 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.487889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.488880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489155 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489572 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.489863 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490303 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.490918 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491364 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.491978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.492892 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.493971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494122 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494709 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494854 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.494989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495582 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.495993 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496266 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.496921 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497529 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.497873 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498794 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.498964 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.499928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.500073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.500760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.500898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.501867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.502056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.502192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.502365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.502504 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503452 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.503893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504311 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.504868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.505862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.506859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507689 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.507975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:38:43.508810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.508942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.509148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.509452 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.509754 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.510113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.510447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.510764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.511088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.511402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.511725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.512037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.512358 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.512682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.512994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.513303 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.513639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.513977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.514292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.514603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.514912 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.515223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.515534 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.516401 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.516735 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.517042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.517368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.517685 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.518039 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.518358 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.518670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.518999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.519309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.519620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.519929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.520240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.520551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.520867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.521180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.521494 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.521810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.522152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.522479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.522807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.523117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.523444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.523773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.524117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.524432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.524775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.525104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.525419 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.525731 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.526061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:38:43.526308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:38:43.573457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO dbcounter [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Registered counter for database nova_api Jul 25 12:38:43.592526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO dbcounter [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Registered counter for database nova_api Jul 25 12:38:43.594474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.601084 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.613123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.621496 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.663540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.context [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fa515c24-2446-4072-8c71-57a58390eeef(cell1) {{(pid=129815) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:38:43.667698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:43.669274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:43.670101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:43.672634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:43.674727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO dbcounter [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Registered counter for database nova_cell0 Jul 25 12:38:43.678729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO dbcounter [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Registered counter for database nova_cell1 Jul 25 12:38:43.679210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.context [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fa515c24-2446-4072-8c71-57a58390eeef(cell1) {{(pid=129816) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 12:38:43.683434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:43.685040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:43.686107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.686236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:38:43.688746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:38:43.689834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.690899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO dbcounter [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Registered counter for database nova_cell0 Jul 25 12:38:43.695019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO dbcounter [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Registered counter for database nova_cell1 Jul 25 12:38:43.696231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.697570 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.702241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.704349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.709318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.711968 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.846023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO dbcounter [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Registered counter for database nova_cell0 Jul 25 12:38:43.854627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_db.sqlalchemy.engines [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.860475 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writer thread running {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:43.860878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO dbcounter [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Registered counter for database nova_cell0 Jul 25 12:38:43.870337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_db.sqlalchemy.engines [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:38:43.875788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writer thread running {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:38:44.190938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: WARNING keystonemiddleware.auth_token [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:38:44.191746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: WARNING keystonemiddleware.auth_token [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:38:44.198363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: WARNING keystonemiddleware.auth_token [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:38:44.199431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: WARNING keystonemiddleware.auth_token [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:38:44.540059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: WARNING keystonemiddleware.auth_token [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:38:44.541073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: WARNING keystonemiddleware.auth_token [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 12:38:44.546074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: WARNING keystonemiddleware.auth_token [None req-0210fb29-e269-40bb-a2d3-654fe9ef621d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:38:44.547581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: WARNING keystonemiddleware.auth_token [None req-9f13f424-6428-430c-89c0-6be31ce6e102 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 12:38:44.551931 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570d32269c0 pid: 129815 (default app) Jul 25 12:38:44.552870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5570d32269c0 pid: 129816 (default app) Jul 25 12:39:28.707617 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:28.708469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:28.709209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:28.714347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:29.471885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-10e4af44-4622-4a75-a751-9eefc3a0bb6e tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2f4971f0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:30.603105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-10e4af44-4622-4a75-a751-9eefc3a0bb6e tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0488f71c-9232-4ca3-bf23-16bd600a7ebb" status: 200 len: 350 microversion: 2.1 time: 1.909800 Jul 25 12:39:30.603675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 1/1] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:39:28 2022] GET /compute/v2.1/os-volumes/0488f71c-9232-4ca3-bf23-16bd600a7ebb => generated 350 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:39:33.024307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4da30f74-54d8-4b59-942b-fd5af7b10c55 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2f4d10d0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:33.083997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:33.084816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:33.085799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:33.086925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:33.529229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-858092543", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:33.760085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] validate_networks() for [('9f36add4-a98d-4ec2-a004-7819cfb577b7', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:34.815747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4da30f74-54d8-4b59-942b-fd5af7b10c55 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/058eeaf7-0001-4e12-b1f2-6c287fb1f637" status: 200 len: 351 microversion: 2.1 time: 2.168222 Jul 25 12:39:34.823536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 1/2] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:39:32 2022] GET /compute/v2.1/os-volumes/058eeaf7-0001-4e12-b1f2-6c287fb1f637 => generated 351 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:37.942072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:37.943162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:37.943800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:37.944347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:37.944901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:37.982991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.990035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:37.991627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:37.995043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:38.056230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3b67770b-3cf4-4142-8ffc-9a635cba0540 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: .version_select at 0x7f4c2fcf2a60>, body: {"keypair": {"name": "tempest-keypair-1136380267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtkfFht4GtK87Qi75SaM9gN41cHMACyu0TcKdC7/xJMY/SFGP1L8kQf32fj3HkK2hANdOaU6tgVjx+fqmght6jiHs+kZHgI7dfs7RGC/eGJNxyhbVB6U9b7o7txPdKjhQ=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:38.062866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:38.074254 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for user e56531920fc548a3a37f63ca0d1e5d82 and project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:38.087695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:38.091098 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:38.170902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-3b67770b-3cf4-4142-8ffc-9a635cba0540 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for project df3ed3c23dde49b382ce9016e421e4de. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:38.195743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-3b67770b-3cf4-4142-8ffc-9a635cba0540 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for user 1bc5799ac34349518854829ec2c259f9 and project df3ed3c23dde49b382ce9016e421e4de. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:38.241115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f3671244-e74b-4741-8942-8ad58122d04e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.336947 Jul 25 12:39:38.242096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 2/3] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 5339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:38.254474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e31ac45a-1fb4-4ba0-a119-60aab2904c2b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:38.255365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e31ac45a-1fb4-4ba0-a119-60aab2904c2b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:38.320669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3b67770b-3cf4-4142-8ffc-9a635cba0540 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.914315 Jul 25 12:39:38.321680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 2/4] 10.222.0.60 () {62 vars in 1200 bytes} [Mon Jul 25 12:39:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 917 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:39:38.682631 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e31ac45a-1fb4-4ba0-a119-60aab2904c2b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:38.719007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e31ac45a-1fb4-4ba0-a119-60aab2904c2b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1221 microversion: 2.1 time: 0.468712 Jul 25 12:39:38.724234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 3/5] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:38 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1221 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:38.990996 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-235240348", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:39.143275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] validate_networks() for [('9f36add4-a98d-4ec2-a004-7819cfb577b7', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:41.118008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:41.119047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:41.119698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:41.120249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:41.120821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:41.142314 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.149427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.150362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:41.150842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:41.238463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:41.253060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for user e56531920fc548a3a37f63ca0d1e5d82 and project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:41.280579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:41.283423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:41.455606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-412e52b2-6552-4d12-b8e1-42e743697db0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.469401 Jul 25 12:39:41.456781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 3/6] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:41.471453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9e7546a6-656f-430b-b32c-383b39834561 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:41.473843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9e7546a6-656f-430b-b32c-383b39834561 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:41.797456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9e7546a6-656f-430b-b32c-383b39834561 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:41.809712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9e7546a6-656f-430b-b32c-383b39834561 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1221 microversion: 2.1 time: 0.342723 Jul 25 12:39:41.811540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:41 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:42.422576 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-60693142-e83b-445f-8996-a22f358344e9 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2e9e6670>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.594047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-60693142-e83b-445f-8996-a22f358344e9 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6b1cda1b-1454-4974-ab28-b443aa5beda6" status: 200 len: 351 microversion: 2.1 time: 0.176803 Jul 25 12:39:42.594878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:39:42 2022] GET /compute/v2.1/os-volumes/6b1cda1b-1454-4974-ab28-b443aa5beda6 => generated 351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:42.607607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-79505bd2-02f1-4a2d-b64c-32317aa132e7 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2e1e39d0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.832774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5ee48489-3cf4-405b-b137-cf87cee25009 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:42.833569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5ee48489-3cf4-405b-b137-cf87cee25009 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:43.088394 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-79505bd2-02f1-4a2d-b64c-32317aa132e7 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.484438 Jul 25 12:39:43.089071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 5/9] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Jul 25 12:39:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:43.106781 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b1552c21-91a0-4386-a78d-e81c1106a38f tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2e1ec940>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:43.352257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5ee48489-3cf4-405b-b137-cf87cee25009 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:43.368875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b1552c21-91a0-4386-a78d-e81c1106a38f tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.266236 Jul 25 12:39:43.370027 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1149 bytes} [Mon Jul 25 12:39:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:43.384516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-670406628", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bffa19eb-1fbf-4353-b2d6-9e8d3cb1c337"}], "security_groups": [{"name": "tempest-securitygroup--1441165373"}], "key_name": "tempest-keypair-1136380267", "user_data": "}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:43.421758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5ee48489-3cf4-405b-b137-cf87cee25009 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1221 microversion: 2.1 time: 0.586249 Jul 25 12:39:43.439819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:42 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1221 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:43.460653 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2851e314-49de-4efd-aedb-0dfe15b1548b tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2e9e6d30>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.012477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] validate_networks() for [('bffa19eb-1fbf-4353-b2d6-9e8d3cb1c337', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:44.050565 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2851e314-49de-4efd-aedb-0dfe15b1548b tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.607809 Jul 25 12:39:44.060013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1134 bytes} [Mon Jul 25 12:39:43 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:44.066739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-664e8701-f981-46b4-9ab9-3a69f00e3e15 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2ea0a430>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.565896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-664e8701-f981-46b4-9ab9-3a69f00e3e15 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.504700 Jul 25 12:39:44.566706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1167 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:39:44.580651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:44.581438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:44.608239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.608938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:44.616278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:44.617895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:45.440057 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:45.484083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-36de3c53-3333-49f0-ac26-8f6f4aa8b805 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1291 microversion: 2.1 time: 0.916128 Jul 25 12:39:45.485161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 8/14] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:44 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1291 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:45.504789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-409e95d8-f149-4d49-a44b-f338e01c9e97 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2ea0af70>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:45.706569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-409e95d8-f149-4d49-a44b-f338e01c9e97 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220168 Jul 25 12:39:45.716234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 9/15] 10.222.0.60 () {58 vars in 1170 bytes} [Mon Jul 25 12:39:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:45.721361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9e84be50-1aac-4e4e-a4a1-df7c5f3fd651 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2d984dc0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.183970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9e84be50-1aac-4e4e-a4a1-df7c5f3fd651 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.466545 Jul 25 12:39:46.185678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 10/16] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Jul 25 12:39:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:46.200424 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1d65ea21-f1b1-4cc5-9e67-8184d8a10fc7 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2d984820>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.526613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1d65ea21-f1b1-4cc5-9e67-8184d8a10fc7 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.331006 Jul 25 12:39:46.527517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 11/17] 10.222.0.60 () {58 vars in 1188 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:46.532897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:46.533616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:46.553017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.553751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.554788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:46.555372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:46.834944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:46.850142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bf46a52c-d536-45cd-9274-ddcdd0b15f8b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1279 microversion: 2.1 time: 0.321390 Jul 25 12:39:46.858318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 12/18] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1279 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:46.870396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-557ef39b-068e-496c-ad5a-8e9986ddcc57 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] Calling method '.version_select at 0x7f4c2d984700>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:47.458354 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-557ef39b-068e-496c-ad5a-8e9986ddcc57 tempest-VolumesTestJSON-428153814 tempest-VolumesTestJSON-428153814-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.598830 Jul 25 12:39:47.459156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 13/19] 10.222.0.60 () {58 vars in 1155 bytes} [Mon Jul 25 12:39:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:48.023945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1783406805", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "networks": [{"uuid": "12b081c2-f14a-40b2-adf8-deea7b57cbca"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:48.035840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:48.036750 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:39:48.179302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] validate_networks() for [('12b081c2-f14a-40b2-adf8-deea7b57cbca', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:39:48.755603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:48.757047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:48.757944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:48.759579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:48.760581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:48.787628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:48.791462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:48.792549 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:48.797706 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:48.855890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for project df3ed3c23dde49b382ce9016e421e4de. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:48.869686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for user 1bc5799ac34349518854829ec2c259f9 and project df3ed3c23dde49b382ce9016e421e4de. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:48.909760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:48.912334 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:49.068268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3b11ea5e-8981-4987-bc18-b211529d441d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.696867 Jul 25 12:39:49.068902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 7/20] 10.222.0.60 () {62 vars in 1188 bytes} [Mon Jul 25 12:39:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 5698 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 12:39:49.089648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:49.090295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:49.120420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.120420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:49.121066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:49.121532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:50.244160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.283668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1dafb05c-cc4e-44ab-b1a4-ff81d0f7634e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 1.213526 Jul 25 12:39:50.285407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 8/21] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:49 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:50.317089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:50.330819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:50.563251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.580184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.582937 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:50.591244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-36f8bb38-0cac-4b90-aba6-3ea4c05e3675 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1281 microversion: 2.20 time: 0.301175 Jul 25 12:39:50.595015 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 9/22] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:50 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:51.063655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:39:51.065313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:39:51.066372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:39:51.069031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:39:51.069700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:39:51.113393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.114655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.122806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.125284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.215085 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Getting quotas for project c24e32d2fb6e4a3db413acc06528d15e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:51.237969 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Getting quotas for user b0f3576844744c538a4755221c4added and project c24e32d2fb6e4a3db413acc06528d15e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:51.301201 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:39:51.313198 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:39:51.471210 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f1e485a5-da5f-4e13-b5d3-66562d75ac5e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: .version_select at 0x7f4c2e1ecc10>, body: {"keypair": {"name": "tempest-keypair-495174351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/9hOXv1iXv6AzYt09DkCYJMzSeSa54WQO9QwRuXDPfIkiN0HyVnz2NGHqvkulUqwisJkhz2MM6MMxhqR1Ww7Jot520+hCwJ8FKLUQqRz5dHMa1+S1i5+1xc8Y5noSmDw=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:51.512740 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2410f6ab-c7d9-44f8-a215-c847a61cc95d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.052257 Jul 25 12:39:51.530391 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 14/23] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:39:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:39:51.581408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f1e485a5-da5f-4e13-b5d3-66562d75ac5e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:39:51.586812 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.587600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:51.619606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.620065 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.624239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f1e485a5-da5f-4e13-b5d3-66562d75ac5e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:39:51.634020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:51.634789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:51.804757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f1e485a5-da5f-4e13-b5d3-66562d75ac5e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.206990 Jul 25 12:39:51.809127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 10/24] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:39:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:51.836430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b3a1da44-2c06-4a83-bd57-abb35a891aef tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:51.838250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b3a1da44-2c06-4a83-bd57-abb35a891aef tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:52.444716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b3a1da44-2c06-4a83-bd57-abb35a891aef tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:52.455941 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b3a1da44-2c06-4a83-bd57-abb35a891aef tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1215 microversion: 2.1 time: 0.645500 Jul 25 12:39:52.482651 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 11/25] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1215 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:52.507234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:52.514047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:52.550136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.554117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:52.555395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:52.566850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:53.582032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:53.597870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:53.613067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:53.614906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-669b707f-205e-46ee-af6c-4d56a6c8eb38 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1339 microversion: 2.20 time: 1.129626 Jul 25 12:39:53.615765 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 12/26] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:52 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1339 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:53.621998 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:53.622888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:53.653681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:53.654183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:53.671721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:53.675002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:53.764888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:53.776886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-90e8f6c8-9c00-4e2c-a6f8-bba9c77e672d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 2.244920 Jul 25 12:39:53.797559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:51 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:54.189105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:54.204705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1a713c12-dc3f-4504-8510-77c975952740 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1267 microversion: 2.1 time: 0.587389 Jul 25 12:39:54.208039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 13/28] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:53 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1267 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:54.667623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.668439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.682797 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.685468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.687015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.689749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.805322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:54.806232 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:54.827336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.827828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:54.846769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:54.849485 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.055306 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.079217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.083973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.088291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1791d93e-4545-4a65-a90a-40140aaae324 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1339 microversion: 2.20 time: 1.439691 Jul 25 12:39:56.110793 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 16/29] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1339 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:56.140903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:56.143380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:56.160461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.161110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.162285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.163021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.245847 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:56.260886 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-81931e2f-b85b-4723-b410-b261740a4172 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 1.460595 Jul 25 12:39:56.266590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 14/30] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:54 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:56.421083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-8b39fb46-539c-42b7-bf14-4e4df76fabfb req-91665689-33ad-4e96-a49a-921faf378be5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a2d814-e80f-4925-a7b9-079437015ea9", "tag": "374c317a-9ec5-4783-a0a0-3e363e8ecbb6"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:56.485407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8b39fb46-539c-42b7-bf14-4e4df76fabfb req-91665689-33ad-4e96-a49a-921faf378be5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.491729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8b39fb46-539c-42b7-bf14-4e4df76fabfb req-91665689-33ad-4e96-a49a-921faf378be5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.602734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-8b39fb46-539c-42b7-bf14-4e4df76fabfb req-91665689-33ad-4e96-a49a-921faf378be5 service nova] Creating event network-changed:374c317a-9ec5-4783-a0a0-3e363e8ecbb6 for instance 21a2d814-e80f-4925-a7b9-079437015ea9 on hv-cinder-82549 Jul 25 12:39:56.604064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8b39fb46-539c-42b7-bf14-4e4df76fabfb req-91665689-33ad-4e96-a49a-921faf378be5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:39:56.610544 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.611190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.615405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:56.633359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:56.678312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.compute.rpcapi [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:39:56.679249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] Releasing lock "compute-rpcapi-router" {{(pid=129815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:39:56.729177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-00ee7649-d666-45e6-97ba-24431ab044db None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.460130 Jul 25 12:39:56.735794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:57.142983 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-d9a3c43f-d835-4f69-bf96-1bf546cd8961 req-1e4fdd47-6eed-4f16-8ad7-5f6b65dacedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4821016c-e408-4c18-9334-8b5e11aa18d2", "tag": "c82f357c-9290-4145-9b37-868045fadfa7"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:57.149859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.163343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-91cbadfe-cf3f-4337-ad59-1257c6785ae3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1273 microversion: 2.1 time: 1.051269 Jul 25 12:39:57.165766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 17/32] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:56 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1273 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:57.176336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d9a3c43f-d835-4f69-bf96-1bf546cd8961 req-1e4fdd47-6eed-4f16-8ad7-5f6b65dacedd service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.176734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d9a3c43f-d835-4f69-bf96-1bf546cd8961 req-1e4fdd47-6eed-4f16-8ad7-5f6b65dacedd service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.201477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:57.203522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:57.226141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-d9a3c43f-d835-4f69-bf96-1bf546cd8961 req-1e4fdd47-6eed-4f16-8ad7-5f6b65dacedd service nova] Creating event network-changed:c82f357c-9290-4145-9b37-868045fadfa7 for instance 4821016c-e408-4c18-9334-8b5e11aa18d2 on hv-cinder-82549 Jul 25 12:39:57.227565 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.228492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.232031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.234909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.242203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-d9a3c43f-d835-4f69-bf96-1bf546cd8961 req-1e4fdd47-6eed-4f16-8ad7-5f6b65dacedd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.504621 Jul 25 12:39:57.244700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 16/33] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:39:57.290701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:57.292081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:57.313146 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.314129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.318439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:57.325347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:57.748442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.760213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-69d76c0f-856f-46aa-8d37-3877e8181e20 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.474943 Jul 25 12:39:57.761211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 17/34] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:57 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:39:57.926659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.939577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.941169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:57.946414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2c96dc7c-797a-4136-b223-b46faa576a71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1339 microversion: 2.20 time: 0.768811 Jul 25 12:39:57.948308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 18/35] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:57 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1339 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:39:58.191741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.193017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:58.223836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.227837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.228939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.229603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.444664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a0747d13-0816-4ff0-8d4d-ae1e9d0cdb24 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Action: 'create', calling method: .version_select at 0x7f4c2e133160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-66307642", "metadata": {"Type": "work"}}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a0747d13-0816-4ff0-8d4d-ae1e9d0cdb24 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 120 Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.450171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-66307642", "metadata": {"Type": "work"}}} Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.451494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-66307642', 'metadata': {'Type': 'work'}}}} Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.452234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:39:58.453435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:39:58.454513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 12:39:58.454513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.458640 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a0747d13-0816-4ff0-8d4d-ae1e9d0cdb24 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.459644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a0747d13-0816-4ff0-8d4d-ae1e9d0cdb24 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.305686 Jul 25 12:39:58.461428 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 18/36] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Jul 25 12:39:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 308 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:39:58.472796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-360f68e0-883f-4637-8bd7-7f56d1f94ca9 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Action: 'create', calling method: .version_select at 0x7f4c2e1ece50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491517571", "metadata": {"Type": "work"}}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-360f68e0-883f-4637-8bd7-7f56d1f94ca9 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 120 Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.488078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1491517571", "metadata": {"Type": "work"}}} Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.489476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1491517571', 'metadata': {'Type': 'work'}}}} Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi '0' Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.490441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:39:58.491740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:39:58.492709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 12:39:58.492709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.514167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-360f68e0-883f-4637-8bd7-7f56d1f94ca9 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.515272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-360f68e0-883f-4637-8bd7-7f56d1f94ca9 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.046277 Jul 25 12:39:58.516011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Jul 25 12:39:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:39:58.526168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22a50624-9ca7-4fca-a875-3ecb9de6c7b1 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Action: 'create', calling method: .version_select at 0x7f4c2e133ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-465907908", "metadata": {"Type": "work"}}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22a50624-9ca7-4fca-a875-3ecb9de6c7b1 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 118 Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.533860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-465907908", "metadata": {"Type": "work"}}} Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.535034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-465907908', 'metadata': {'Type': 'work'}}}} Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise error Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi '' Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.535756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 12:39:58.536831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 12:39:58.537758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 12:39:58.537758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.544235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22a50624-9ca7-4fca-a875-3ecb9de6c7b1 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.548211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-22a50624-9ca7-4fca-a875-3ecb9de6c7b1 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024387 Jul 25 12:39:58.549073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 20/38] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Jul 25 12:39:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 25 12:39:58.563493 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1e6c29e7-42f3-458e-afaa-b056ce826712 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Calling method '.version_select at 0x7f4c2d86a5e0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.620661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-1e6c29e7-42f3-458e-afaa-b056ce826712 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] HTTP exception thrown: Volume tempest-invalid-1780016892 could not be found. Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1e6c29e7-42f3-458e-afaa-b056ce826712 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1780016892 HTTP/1.1 Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.624858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Volume tempest-invalid-1780016892 could not be found. Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'tempest-invalid-1780016892'} Jul 25 12:39:58.626724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1780016892 could not be found. (HTTP 404) (Request-ID: req-62de3c54-cb3f-4307-afd4-c07519761807) Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.627462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:39:58.631279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1780016892 could not be found. Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:39:58.634936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1780016892 could not be found. Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1780016892 could not be found. Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1e6c29e7-42f3-458e-afaa-b056ce826712 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 404 to user: Volume tempest-invalid-1780016892 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1e6c29e7-42f3-458e-afaa-b056ce826712 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1780016892" status: 404 len: 99 microversion: 2.1 time: 0.071253 Jul 25 12:39:58.635904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 21/39] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Jul 25 12:39:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1780016892 => generated 99 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:39:58.641248 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-39a323f0-603f-44f1-b99d-3b34d3bf976e tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004913 Jul 25 12:39:58.641248 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 22/40] 10.222.0.60 () {58 vars in 1140 bytes} [Mon Jul 25 12:39:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:39:58.655875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0ce20504-277a-4707-801c-797c86c758c3 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005753 Jul 25 12:39:58.664014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 23/41] 10.222.0.60 () {58 vars in 1137 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 12:39:58.678490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cc72c6b0-c8cb-4db1-bd37-9dd6129a3604 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Calling method '.version_select at 0x7f4c2d86a4c0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.742529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-cc72c6b0-c8cb-4db1-bd37-9dd6129a3604 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] HTTP exception thrown: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cc72c6b0-c8cb-4db1-bd37-9dd6129a3604 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/os-volumes/9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 HTTP/1.1 Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.745230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4'} Jul 25 12:39:58.746932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. (HTTP 404) (Request-ID: req-5c76c294-501a-4e02-89e1-21b00a7a0242) Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.747794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:39:58.750527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:39:58.751532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. Jul 25 12:39:58.752457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.755654 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cc72c6b0-c8cb-4db1-bd37-9dd6129a3604 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 404 to user: Volume 9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.756754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cc72c6b0-c8cb-4db1-bd37-9dd6129a3604 tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4" status: 404 len: 109 microversion: 2.1 time: 0.091449 Jul 25 12:39:58.758451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 24/42] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:39:58 2022] DELETE /compute/v2.1/os-volumes/9a32e7c8-b1e7-40b2-95b5-9ef4b75331d4 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:58.767903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8d6f0af-fe85-4fd8-a668-fc0477604f6f tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Calling method '.version_select at 0x7f4c2d86ad30>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.826156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-b8d6f0af-fe85-4fd8-a668-fc0477604f6f tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] HTTP exception thrown: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8d6f0af-fe85-4fd8-a668-fc0477604f6f tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Request method failure captured: Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/os-volumes/0f91c387-7e38-4e46-b317-28e443a1cb9a HTTP/1.1 Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8drRsOL0hn52GgvOehYY9HAlz-bsEuydNp4NU0vvs-DuaY4UFsYPsU4EPAeuWxOY6X_OsA_notRjUbefwO1TxhUfmCvb7-nsT6Ll-6MRtu-kujQc1LGB27Htph7p-KSPJbSobRQ5RbJDoX2TlgrdbeAaIwLOq_tPy2HOsJfcVZbYU Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:39:58.829674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d12806b9ad9546fcb32a56e76ced516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: d12806b9ad9546fcb32a56e76ced516f Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesNegativeTest-1164879821 Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: abbb41e2fc4b48f79866c0ffb1a792c1 Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesNegativeTest-1164879821-project Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '0f91c387-7e38-4e46-b317-28e443a1cb9a'} Jul 25 12:39:58.831385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. (HTTP 404) (Request-ID: req-cd485547-0a19-4142-92fc-d5935a993a04) Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.832123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:39:58.833626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:39:58.834818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. Jul 25 12:39:58.835760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:39:58.840719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8d6f0af-fe85-4fd8-a668-fc0477604f6f tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] Returning 404 to user: Volume 0f91c387-7e38-4e46-b317-28e443a1cb9a could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:39:58.842671 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b8d6f0af-fe85-4fd8-a668-fc0477604f6f tempest-VolumesNegativeTest-1164879821 tempest-VolumesNegativeTest-1164879821-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/0f91c387-7e38-4e46-b317-28e443a1cb9a" status: 404 len: 109 microversion: 2.1 time: 0.078691 Jul 25 12:39:58.843459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 25/43] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/os-volumes/0f91c387-7e38-4e46-b317-28e443a1cb9a => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:39:58.854429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:58.855158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:58.879362 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.880149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:58.881758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:58.887883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.109078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:59.119375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2d570044-1a8d-470b-a51f-6c28d651a746 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1273 microversion: 2.1 time: 0.934586 Jul 25 12:39:59.136445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 19/44] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1273 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:39:59.144763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:39:59.151110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:39:59.165234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.165940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.167206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:39:59.172253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:39:59.891252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:39:59.913404 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-333594a1-3335-4716-ad11-c07bc26899bf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 1.068627 Jul 25 12:39:59.914548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 26/45] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:39:58 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:00.156568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:00.159800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:00.163385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:00.190167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.190800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.191862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.192450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.392566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.418560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c670b4b1-3830-466a-83eb-898e075306be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1273 microversion: 2.1 time: 0.269461 Jul 25 12:40:00.432644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 27/46] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:00 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:00.911209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.926433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.929292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:00.931242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0f9b9524-65f4-41ef-900a-91809f5f03de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 1.792788 Jul 25 12:40:00.937866 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 20/47] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:39:59 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:00.939605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:00.940322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:00.951896 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.952417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:00.953718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:00.954354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.128006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:01.141106 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fe535abd-620c-4b0c-a571-50b79656ca22 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.204510 Jul 25 12:40:01.143266 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 28/48] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:00 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:01.440326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:01.440935 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:01.456025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:01.456756 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=18 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:01.467442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.467889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.468680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.469191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.957440 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:01.958038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:01.965461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.965900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:01.966731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:01.974078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.146549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.163362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b36eda52-32c8-4b64-ab7a-1f7c6e252cbe tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.724105 Jul 25 12:40:02.179322 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 21/49] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:01 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:02.188052 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:02.190200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:02.197482 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.198279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.199866 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:02.200523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:02.292587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.312124 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.318350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.320568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4893fb9d-664d-4ed6-9469-781b93669ac5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.367108 Jul 25 12:40:02.325949 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 29/50] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:01 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:02.577371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:02.585154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a7478c79-1f77-4842-bb22-09f0c1ceba3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.404455 Jul 25 12:40:02.585861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 22/51] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:02 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:03.021238 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592562656", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4181ae2d-cd73-4cb4-a9d0-f28fef05143a"}], "security_groups": [{"name": "tempest-securitygroup--544207172"}], "key_name": "tempest-keypair-495174351", "user_data": "}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:03.047690 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=24 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:03.129820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-272aa2ca-b3fa-4a6a-9555-4d9383391f4f req-118eae98-0107-4dc6-8e80-b3c3732b80e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:03.150026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:03.163383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-272aa2ca-b3fa-4a6a-9555-4d9383391f4f req-118eae98-0107-4dc6-8e80-b3c3732b80e3 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.163973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-272aa2ca-b3fa-4a6a-9555-4d9383391f4f req-118eae98-0107-4dc6-8e80-b3c3732b80e3 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.219633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=65 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:03.222025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-272aa2ca-b3fa-4a6a-9555-4d9383391f4f req-118eae98-0107-4dc6-8e80-b3c3732b80e3 service nova] Creating event network-changed:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:40:03.231817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-272aa2ca-b3fa-4a6a-9555-4d9383391f4f req-118eae98-0107-4dc6-8e80-b3c3732b80e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 12:40:03.236421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.242728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.243668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.244175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.256643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.compute.rpcapi [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 12:40:03.257825 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] Releasing lock "compute-rpcapi-router" {{(pid=129816) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 12:40:03.288093 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] validate_networks() for [('4181ae2d-cd73-4cb4-a9d0-f28fef05143a', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:03.291784 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-14e4f6bc-34fd-40a6-a58d-67d05a3b2c2c None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165969 Jul 25 12:40:03.293721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 23/52] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:40:03.301195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:03.301979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:03.335086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.335543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.338915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.339898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.617160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:03.626955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7f37c5ea-24f9-401a-8f6d-fc39c5b9de12 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.330951 Jul 25 12:40:03.640945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 24/53] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:03 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:03.649131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:03.650129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:03.666013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.666694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.667728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.668351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.832276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:03.839975 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:03.840392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:03.840854 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:03.841294 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:03.842247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:03.849586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:03.851348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:03.852458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f7104b2d-8773-48e6-b731-cc6520d50317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.210498 Jul 25 12:40:03.853160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 25/54] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:03 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:03.856573 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.857143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.858733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:03.859334 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.859908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:03.860228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.866181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.866782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.867702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:03.868273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:03.887642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:03.895571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:03.909878 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:03.912040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:03.995174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ccca7fdb-5964-491e-a411-45665d80e68b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.979689 Jul 25 12:40:03.996435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 30/55] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:04.009231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-33c8f1d3-c22c-44c2-81e7-238c09697145 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.012500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-33c8f1d3-c22c-44c2-81e7-238c09697145 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.078408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-33c8f1d3-c22c-44c2-81e7-238c09697145 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.088107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.097048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a7b0d5d3-dd47-492f-b2f5-f72937a88277 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.242570 Jul 25 12:40:04.097633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 26/56] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:03 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.112072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-33c8f1d3-c22c-44c2-81e7-238c09697145 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1240 microversion: 2.1 time: 0.107931 Jul 25 12:40:04.115747 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 31/57] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.659544 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.660326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.673346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.673742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.676531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.677588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.860351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:04.870718 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4bd9b8c4-0d0e-4e5c-8de9-05544e7efe9c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.215947 Jul 25 12:40:04.879952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:04.880873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:04.887146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 27/58] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:04.887639 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.888246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:04.889521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:04.889893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.073723 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.082450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.083954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.085052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-183474ab-f326-4a62-a65a-537a4afb97f6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.209519 Jul 25 12:40:05.098439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 32/59] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:04 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:05.131622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.132530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.135963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.136906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.140352 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.142066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.142843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.144026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.145288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.145892 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.147162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.147729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.226876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.235415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d4236447-aa46-428e-9d80-36a268ec88b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1244 microversion: 2.1 time: 0.104445 Jul 25 12:40:05.236609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 33/60] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:05.354215 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:05.363359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4476b7f3-a862-4f5a-8a7b-c1420464a37e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.237239 Jul 25 12:40:05.364100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 28/61] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:05.896832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:05.897864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:05.904808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.905338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:05.906057 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:05.906498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.070597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.078850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ee76e1d8-4672-4c42-bee2-3fc2143787fa tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.186177 Jul 25 12:40:06.079665 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 34/62] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:05 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:06.108346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.110225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.117236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.117736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.118726 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.119319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.257119 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.257743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.265776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.266273 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.267038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.267472 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.348791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.359033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.361131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.363942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8663049c-96cb-4f98-b9d1-dafdf89f1b25 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.258868 Jul 25 12:40:06.365136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 29/63] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:06.368454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.383553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e3cdc793-8d35-4bc6-926f-51de31433c18 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1244 microversion: 2.1 time: 0.130968 Jul 25 12:40:06.384349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1244 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:06.388190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:06.390554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:06.399861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.400716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.402168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:06.403136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:06.549102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:06.556929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-94e1a6b0-de93-4d85-a385-f601df52ee33 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.173848 Jul 25 12:40:06.557494 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 30/65] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:06 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:07.100042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.100658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.106589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.107028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.107795 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.108225 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.248661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.256375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-24f257c4-db69-46ba-9cb1-304eaa039794 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.160142 Jul 25 12:40:07.256946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 36/66] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:07.390374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.390909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.397059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.397512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.398300 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.398737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.408906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.409615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.415988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.416547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.417442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.419785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.485434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.489081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:07.494075 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-13ef6a0b-ca5e-487a-9bfa-64d56f1b4cdb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1244 microversion: 2.1 time: 0.089197 Jul 25 12:40:07.506114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 37/67] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:07.545425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.553638 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.555253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.556341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3d048594-ffa6-49da-99ac-3331d0241135 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.170464 Jul 25 12:40:07.556815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 31/68] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:07.577353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:07.578116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:07.584249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.584694 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.585451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:07.585891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:07.722785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:07.730091 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8199cfb6-2e49-415c-afa6-7243f4bd450e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.157449 Jul 25 12:40:07.730660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 38/69] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:07 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.283846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.284520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.290934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.291378 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.292142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.292573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.444781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.459808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f8ed2245-cff7-4480-af5a-17dd7d19bc3f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.185907 Jul 25 12:40:08.460601 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 32/70] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.517324 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.518160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.525078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.527187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.528082 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.528586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.582721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.583589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.591393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.593056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.594578 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.595162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.624655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.634015 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5d2f3a66-3cb2-4460-86ab-762b58dda023 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1244 microversion: 2.1 time: 0.121087 Jul 25 12:40:08.634975 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 39/71] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1244 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:08.750776 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.752320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:08.753132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:08.760059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.761683 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.762449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.762592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:08.762919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:08.764657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.766121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bda6f6b7-9956-406a-959c-060ad9a283dd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.190143 Jul 25 12:40:08.767204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 33/72] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:08.905873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:08.913664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5cb3f325-3b67-414b-9048-92dfdf692501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.165987 Jul 25 12:40:08.914287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 40/73] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:08 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:09.483186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.483786 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.490566 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.491208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.491962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.492536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.649167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.657674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.658322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.665321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4d1bea27-28b1-4e31-9ee9-32399b59f39b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.186362 Jul 25 12:40:09.666433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 34/74] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:09.672495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.673156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.674184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.675035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.754184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.762256 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e349460a-0ec2-4eda-a5a2-1b9fdfc707ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1244 microversion: 2.1 time: 0.108599 Jul 25 12:40:09.763718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 41/75] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:09.789637 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.790511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.800803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.802901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.804714 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.806738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.935321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:09.936085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:09.942317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.943276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.944228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:09.944947 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:09.968669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.978777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.980290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:09.981398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b24a3e8e-2695-436c-80a2-edbff9820090 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.196318 Jul 25 12:40:09.982317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 35/76] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:10.111732 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:10.119705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0f46a918-f01e-43a0-8dee-6bc14ddfe70c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.188639 Jul 25 12:40:10.120485 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 42/77] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:09 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:10.690983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:10.692304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:10.716679 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:10.717134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:10.717953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:10.718373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:10.784461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:10.785054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:10.806176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:10.807048 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:10.810036 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:10.818828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:10.953229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:10.965260 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-539bb14e-78f2-48f9-b2de-7e0deba8dcf7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1292 microversion: 2.1 time: 0.185210 Jul 25 12:40:10.965731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 43/78] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:10 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1292 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:11.004034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.007005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:11.007828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:11.015594 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-66b9d232-9443-4819-99ec-a665b255e6d9 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.329152 Jul 25 12:40:11.016221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.017018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 36/79] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:10 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:11.020530 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.021756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.022519 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.142698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:11.143499 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:11.196157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.197002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.198676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.199461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.288357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.301272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.303854 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.306683 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ba0a2a74-4e26-4d4d-ba8b-df257433a126 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.304978 Jul 25 12:40:11.310406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 44/80] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:10 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:11.584209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:11.596916 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7898ebbb-d8dc-483b-af45-b37d439eb76c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.458730 Jul 25 12:40:11.623560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 37/81] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:11 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:11.678612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-de745b0c-f932-4da9-8abc-3822aed293d5 req-34ab732c-b37d-411c-8a83-80b8a57f31cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e70f44-23c1-40de-860c-90f2398674f7", "tag": "6ecc27e1-98d7-4798-be46-819997310608"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:11.698352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-de745b0c-f932-4da9-8abc-3822aed293d5 req-34ab732c-b37d-411c-8a83-80b8a57f31cf service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:11.700365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-de745b0c-f932-4da9-8abc-3822aed293d5 req-34ab732c-b37d-411c-8a83-80b8a57f31cf service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:11.727984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-de745b0c-f932-4da9-8abc-3822aed293d5 req-34ab732c-b37d-411c-8a83-80b8a57f31cf service nova] Creating event network-changed:6ecc27e1-98d7-4798-be46-819997310608 for instance 29e70f44-23c1-40de-860c-90f2398674f7 on hv-cinder-82549 Jul 25 12:40:11.742418 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-de745b0c-f932-4da9-8abc-3822aed293d5 req-34ab732c-b37d-411c-8a83-80b8a57f31cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070247 Jul 25 12:40:11.743217 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 45/82] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:11.987107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:11.988453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.000236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.000711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.003088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.003528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.050431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.050431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.061042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.063765 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.065013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.067297 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.102471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.112751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1c26087d-876a-4a23-a942-fa80f5879b08 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1292 microversion: 2.1 time: 0.127688 Jul 25 12:40:12.112751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 38/83] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:11 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.243417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.251807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-075c8613-a4c2-4d21-ad8a-3589ae7b433f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.212846 Jul 25 12:40:12.252382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 46/84] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:12.332012 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.332857 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.352944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.355121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.356037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.359810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.550792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.559391 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.561878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.563176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-45629e2d-1e49-4410-8710-343e8babdd41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.235689 Jul 25 12:40:12.580218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 39/85] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:12.627081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:12.628466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:12.635486 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.635945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.636819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:12.637265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:12.787168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:12.795647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b3bfdeb6-81d7-4ce8-b479-ab0cb9b07fe1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.176785 Jul 25 12:40:12.796297 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 47/86] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:12 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:13.136699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.137406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.144283 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.144808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.145773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.146295 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.150651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:13.213180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.221026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ee00bc8e-0ac1-4ca0-b67f-c186f265cb3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1292 microversion: 2.1 time: 0.088478 Jul 25 12:40:13.221599 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 40/87] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:13.275011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.275633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.284158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.284899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.285720 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.286328 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.445438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.452981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-32bc0e5d-d8f5-4307-871a-d8785c1476f6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.183494 Jul 25 12:40:13.453554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 48/88] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:13.587260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.587896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.590168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:13.596549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.597031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.597933 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.598380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.762291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.772038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.778054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.778054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fcf1d22e-13f1-4375-8791-1346853d729f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.191731 Jul 25 12:40:13.778054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 41/89] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:13.817446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:13.818411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:13.826792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.828515 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.829967 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:13.830484 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:13.873096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:13.970286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:13.978190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-330ba382-4a62-4fba-b303-6d7d258b6970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.165414 Jul 25 12:40:13.981990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 49/90] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:13 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.241551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.242197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.251394 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.253518 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.254526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.254973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.322483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:14.331882 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8dd90224-2bb3-472e-9ad5-f802192f3384 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1292 microversion: 2.1 time: 0.093812 Jul 25 12:40:14.333977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 42/91] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.473852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.474488 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.476366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:14.481829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.482794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.483548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.483987 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.624580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:14.632320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5f0ad726-29e2-476f-bdfd-eea0c51d99c6 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.162091 Jul 25 12:40:14.632903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 50/92] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:14.799891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:14.800792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:14.809602 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.810340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.811356 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:14.812190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:14.999578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:15.000966 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:15.007467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.008340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.009393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.009901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.229633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.242939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.245369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.246832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-56ed4e5e-0de0-465e-8bf6-55b0a792d532 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.452779 Jul 25 12:40:15.249380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 43/93] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:15.355372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:15.359205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:15.361773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.372521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6a859629-ab9b-40eb-8214-6232aa3ff4ec tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.375637 Jul 25 12:40:15.374370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.374818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.376162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 51/94] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:14 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:15.378622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.379081 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.469614 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.483612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f85d6c0e-8353-48cf-9a7a-176c00308770 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1298 microversion: 2.1 time: 0.133522 Jul 25 12:40:15.484899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 44/95] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:15 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:15.652976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:15.654682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:15.667939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.668597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.669546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:15.670721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:15.949052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:15.957829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-675404fb-71fa-4a63-94a6-aed3ff6c64d0 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.308977 Jul 25 12:40:15.963215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 52/96] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:15 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:16.166119 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-807fdfc8-3104-4e54-b1b0-dead6ba9f76a req-b7ba37e2-cacd-476a-abbf-7d40df2ec93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a2d814-e80f-4925-a7b9-079437015ea9", "name": "network-vif-plugged", "status": "completed", "tag": "374c317a-9ec5-4783-a0a0-3e363e8ecbb6"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:16.175888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-807fdfc8-3104-4e54-b1b0-dead6ba9f76a req-b7ba37e2-cacd-476a-abbf-7d40df2ec93e service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.176309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-807fdfc8-3104-4e54-b1b0-dead6ba9f76a req-b7ba37e2-cacd-476a-abbf-7d40df2ec93e service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.187869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-807fdfc8-3104-4e54-b1b0-dead6ba9f76a req-b7ba37e2-cacd-476a-abbf-7d40df2ec93e service nova] Creating event network-vif-plugged:374c317a-9ec5-4783-a0a0-3e363e8ecbb6 for instance 21a2d814-e80f-4925-a7b9-079437015ea9 on hv-cinder-82549 Jul 25 12:40:16.193166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-807fdfc8-3104-4e54-b1b0-dead6ba9f76a req-b7ba37e2-cacd-476a-abbf-7d40df2ec93e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092784 Jul 25 12:40:16.193951 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 45/97] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:16.270043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.270647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.277685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.278167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.278994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.279427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.400906 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.402258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.408429 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.408878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.414403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.414403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.435888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.453763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.455996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.457459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b8a2b82d-faf5-4272-b0e5-40f063e8212b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.191369 Jul 25 12:40:16.458060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 53/98] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:16.504747 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.505369 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.513138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.514676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.515627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.516188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.547778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.556809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2b842d6d-1411-4a1a-9360-72e4fa109d5b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.160273 Jul 25 12:40:16.557387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 46/99] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:16.587377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:16.594762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4d47d48b-2341-4d12-861f-b578e8b1cbe1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1298 microversion: 2.1 time: 0.093850 Jul 25 12:40:16.595670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 54/100] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:16.983837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:16.984698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:16.990618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.991065 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:16.991825 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:16.992259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.130750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.139492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-259d909d-3f87-4052-a874-e880721d3c25 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.159924 Jul 25 12:40:17.140119 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 47/101] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:16 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.480339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.480936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.487267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.487712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.488451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.488876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.492655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:17.578520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.579127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.584950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.585394 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.586172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.586606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.615120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.623073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.624563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.625657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fcbfd062-494b-4446-80ab-fdeda9de0260 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.149105 Jul 25 12:40:17.626252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 55/102] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:17.630603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:17.631207 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:17.638010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.638970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.639724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:17.640150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:17.699697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.707674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9a591e50-73e2-46b1-8563-ed10238baf7d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1298 microversion: 2.1 time: 0.080481 Jul 25 12:40:17.708241 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 56/103] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:17.713260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:17.721136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a9d77d87-902d-4d96-b422-c4700cd62fab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.147045 Jul 25 12:40:17.722266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 48/104] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:17 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:18.160330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.160931 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.166911 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.167366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.168112 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.168543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.293731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.301493 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5d02d690-91f4-4073-915e-91ff50b40c8d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.144945 Jul 25 12:40:18.302244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 57/105] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:18.648503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.649050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.655480 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.655923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.656675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.657105 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.728587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.729357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.737175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.737701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.738589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.739255 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.790858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.800657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.800787 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.802561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.803975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-16032791-1cea-45c9-91d9-011e7c442539 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.159353 Jul 25 12:40:18.804763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 49/106] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:18.808836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-faf3c97c-34dc-4d7f-b1c2-577f1d690b8f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1298 microversion: 2.1 time: 0.084009 Jul 25 12:40:18.809729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 58/107] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:18.810116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:18.810866 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:18.816732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.817176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.817950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:18.818589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:18.952418 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:18.960336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6739338f-0169-4940-aa86-f3256b8cce3e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.154495 Jul 25 12:40:18.960904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 50/108] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:18 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.322684 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.323289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.329732 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.330211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.330963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.331408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.474727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.483425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8bcaf767-3aa8-4e24-9c55-19777649bacc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.164478 Jul 25 12:40:19.484211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 59/109] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:19.826953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.827657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.829186 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.830323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.834271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.834719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.835482 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.835923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.836400 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.836838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.837588 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.838044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.967708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:19.977689 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0f5a20f4-0556-4d98-8645-f2379487e386 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.152135 Jul 25 12:40:19.978496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 60/110] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:19.983966 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:19.984823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:19.998288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.998677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:19.999450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:19.999880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.043624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.052430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.053944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.055210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-569d4ce3-b627-44bc-949d-57e3cae44ff3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.232282 Jul 25 12:40:20.056085 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 51/111] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:20.142074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.149871 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-50c6e165-4f77-42bf-989b-9ec4303d0093 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.170040 Jul 25 12:40:20.150686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 61/112] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:19 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:20.504365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.504976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:20.510845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.511291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.512040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:20.512469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:20.637327 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:20.645075 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8bc487cd-f342-4a30-ac16-b08c6557ebea tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.144434 Jul 25 12:40:20.645641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 52/113] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:20.998959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:20.999461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.005882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.006333 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.007306 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.007697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.079926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.080535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.086650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.087097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.087872 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.088287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.155365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.175071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9d3bda10-a65f-4662-8dbb-a82287a08af9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.179950 Jul 25 12:40:21.176049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 62/114] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:20 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:21.181199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.182212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.189672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.190655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.191867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.192644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.268978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.280959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.285710 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.287065 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b7275cf1-c2d2-4ce3-9862-5470da6d34ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.212501 Jul 25 12:40:21.289099 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 53/115] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:21.296022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-0c630ad6-1c0e-4fac-82a7-233a9a2014fa req-e89a8883-2775-4538-a17d-1c8331f1d191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4821016c-e408-4c18-9334-8b5e11aa18d2", "name": "network-vif-plugged", "status": "completed", "tag": "c82f357c-9290-4145-9b37-868045fadfa7"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:21.311322 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0c630ad6-1c0e-4fac-82a7-233a9a2014fa req-e89a8883-2775-4538-a17d-1c8331f1d191 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.311701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0c630ad6-1c0e-4fac-82a7-233a9a2014fa req-e89a8883-2775-4538-a17d-1c8331f1d191 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.324141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-0c630ad6-1c0e-4fac-82a7-233a9a2014fa req-e89a8883-2775-4538-a17d-1c8331f1d191 service nova] Creating event network-vif-plugged:c82f357c-9290-4145-9b37-868045fadfa7 for instance 4821016c-e408-4c18-9334-8b5e11aa18d2 on hv-cinder-82549 Jul 25 12:40:21.330287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-0c630ad6-1c0e-4fac-82a7-233a9a2014fa req-e89a8883-2775-4538-a17d-1c8331f1d191 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039759 Jul 25 12:40:21.331178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 54/116] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:21.358310 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.365768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d828d3b1-fbf4-4c94-870e-8245da1c7cc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.188525 Jul 25 12:40:21.367095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 63/117] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:21.666256 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:21.666955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:21.673122 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.673634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.674418 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:21.674852 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:21.817169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:21.825090 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4f81bdb4-569a-4da8-a757-2de42021395e tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.163061 Jul 25 12:40:21.825736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 55/118] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:21 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:22.198360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.198991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.205013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.205459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.206240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.206678 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.310742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.311348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.317195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.317644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.318438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.318876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.340132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.347977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b5bd18de-424a-4f3e-9aac-9deeed7213e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.153448 Jul 25 12:40:22.348543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 64/119] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:22.386201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.386836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.393122 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.393564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.394364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.394958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.446246 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.454344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.455928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.457489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d23d60dd-bd48-436d-8693-4106a4cf0203 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.150309 Jul 25 12:40:22.458398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 56/120] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:22.524088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:22.532474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fb68d023-5c54-4076-83de-a20044860add tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.149990 Jul 25 12:40:22.533072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 65/121] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:22.848169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:22.848768 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:22.854713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.855152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.855897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:22.856324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:22.992332 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.000390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-246c0fab-fb4d-46ad-af1a-fc76188f4e0b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.155975 Jul 25 12:40:23.000945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 57/122] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:22 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.369608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.370242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.376748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.377221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.377992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.378424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.480368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.480973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.487805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.488243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.488997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.489426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.493479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:23.507612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.514928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-568652b2-34aa-4395-afac-8215d6a5b446 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.149134 Jul 25 12:40:23.515621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 66/123] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:23.559452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:23.560702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:23.566662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.567362 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.567850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:23.568276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:23.618455 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.626944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.628362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.629443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1b750cea-c7bc-4a5f-889b-e86cc3cfe57d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.152882 Jul 25 12:40:23.630038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 58/124] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:23.694982 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:23.702767 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0c7848fd-46a3-40b0-a8f8-9f6cc0bce7b9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.153121 Jul 25 12:40:23.703543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 67/125] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:23 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:24.021971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.022579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.028539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.029570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.030358 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.030789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.160295 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.167524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-291a902b-77ac-4429-8bb0-a2154a4044bd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.149328 Jul 25 12:40:24.168292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 59/126] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:24.535448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.536045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.538121 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:24.543054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.543492 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.544238 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.544660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.651445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.652243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.658331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.658861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.659692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.660132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.675046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.682428 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4c485312-3503-4ff1-b81a-63a7e69cd5e7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.150766 Jul 25 12:40:24.682992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 68/127] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:24.723836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:24.724899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:24.731472 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.732066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.733040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:24.733550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:24.807332 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.817492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.819321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.820551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8cd4af97-0c2d-4de8-b220-3e77cee48cf1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.172986 Jul 25 12:40:24.821627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 60/128] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:24.880980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:24.889986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7493952a-6319-46ea-b874-db70830aa7ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.170135 Jul 25 12:40:24.890774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 69/129] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:24 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:25.187858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.188791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.194410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.195026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.195779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.196211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.318678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.326465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fb0de2ad-acf5-48d9-8f12-0c93b2ee1284 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.141881 Jul 25 12:40:25.327018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 61/130] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:25.703246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.703856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.709791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.710266 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.711020 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.711453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.844497 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:25.851951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-89585ce2-9009-4ddf-9383-e114a415be6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.152457 Jul 25 12:40:25.852703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 70/131] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:25.854305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.854906 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.863505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.863953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.864725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.865151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.909875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:25.910487 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:25.916323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.916762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.917505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:25.917953 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:25.995381 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.004207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.005701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.006840 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2e5e7217-cb43-4e01-87f2-ae9b8a0e8b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.156584 Jul 25 12:40:26.007529 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 62/132] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:26.050285 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.053614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:26.058466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5c29a96e-6057-4a6a-8031-034621db8bc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.152345 Jul 25 12:40:26.059028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 71/133] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:25 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:26.347472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:26.348074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:26.354164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.354641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.355390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.356043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.482084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:26.489571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6234e81c-f5d5-454f-9393-f095506f21be tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.145888 Jul 25 12:40:26.490170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 63/134] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:26 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:26.874372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:26.875227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:26.884728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.885180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:26.885986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:26.886421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.029559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.030451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:27.037487 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.038061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.038915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.039428 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.061732 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.078637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-20eeae15-8c85-4a05-954e-37757e2cc53f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.209481 Jul 25 12:40:27.078866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 72/135] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:26 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:27.086380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.088029 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:27.097814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.098315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.099532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.099532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.327385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.337002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a32a8353-a7c3-4d9a-b69d-a17ef7c4c038 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.256911 Jul 25 12:40:27.337667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 73/136] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:27.418586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.428796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.436634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.438218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b4ab371c-7ea1-4584-ad86-a95f78ced4b6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.413102 Jul 25 12:40:27.440138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 64/137] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:27.510764 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:27.511849 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:27.519753 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.521483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.523637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.524815 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.644224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-143c68d3-e25f-4952-91ed-e9f09a592b58 req-73270eec-d223-4a7e-9a3a-13f6579d0605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0e67fb-85b0-495f-82fa-816792a84b43", "tag": "ed8c1b70-0793-46e8-96ee-8e247d00d8a4"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:27.665649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-143c68d3-e25f-4952-91ed-e9f09a592b58 req-73270eec-d223-4a7e-9a3a-13f6579d0605 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:27.671518 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-143c68d3-e25f-4952-91ed-e9f09a592b58 req-73270eec-d223-4a7e-9a3a-13f6579d0605 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:27.693807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-143c68d3-e25f-4952-91ed-e9f09a592b58 req-73270eec-d223-4a7e-9a3a-13f6579d0605 service nova] Creating event network-changed:ed8c1b70-0793-46e8-96ee-8e247d00d8a4 for instance eb0e67fb-85b0-495f-82fa-816792a84b43 on hv-cinder-82549 Jul 25 12:40:27.701549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-143c68d3-e25f-4952-91ed-e9f09a592b58 req-73270eec-d223-4a7e-9a3a-13f6579d0605 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061558 Jul 25 12:40:27.705214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 65/138] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:40:27.746560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:27.756856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-61411472-abca-456f-99ac-b818dd259211 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.250126 Jul 25 12:40:27.757962 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 74/139] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:27 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:28.100052 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:28.100849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:28.107197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.107875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.108649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.109072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.250077 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.258509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-afa4faeb-7748-4279-8caa-24abb870c63f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.163209 Jul 25 12:40:28.259149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 66/140] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:28 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:28.357878 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:28.358509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:28.365298 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.365810 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.366609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.367317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.467395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:28.468081 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:28.474692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.475654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.476756 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.477330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.517772 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.527559 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c565def8-8479-40c6-9418-0dd556be482b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.172825 Jul 25 12:40:28.538134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 75/141] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:28 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:28.685856 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.696640 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.698249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:28.699787 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-123f4d5a-2c82-4d0f-aafc-e8e55605c8a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.238595 Jul 25 12:40:28.701849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 67/142] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:28 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:28.784535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:28.787533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:28.799313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.800915 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.803458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.804221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.904394 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-c353659c-4f58-46c1-8423-0529f3008a19 req-a734291f-454c-4247-bab6-030c1e4cd0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:28.938034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-c353659c-4f58-46c1-8423-0529f3008a19 req-a734291f-454c-4247-bab6-030c1e4cd0e4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:28.939881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-c353659c-4f58-46c1-8423-0529f3008a19 req-a734291f-454c-4247-bab6-030c1e4cd0e4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:28.973009 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-c353659c-4f58-46c1-8423-0529f3008a19 req-a734291f-454c-4247-bab6-030c1e4cd0e4 service nova] Creating event network-vif-plugged:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:40:28.985803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-c353659c-4f58-46c1-8423-0529f3008a19 req-a734291f-454c-4247-bab6-030c1e4cd0e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086314 Jul 25 12:40:28.991921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 68/143] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:29.057133 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.066812 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8b244ad0-e799-443d-a514-f356fb4d0fe7 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.292784 Jul 25 12:40:29.078280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 76/144] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:28 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:29.284953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:29.286018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:29.294961 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.295406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.296402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.296978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.491355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.498986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f120cb90-d1de-46e7-91cf-84c7ec023005 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.221901 Jul 25 12:40:29.500625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 69/145] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:29 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:29.551910 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:29.552545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:29.560170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.561158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.562284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.562721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.724283 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:29.725690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:29.728985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.733287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.733805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.735025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:29.735623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:29.742510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-24ad923c-91de-4c5c-b781-3b757a2ec562 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.194210 Jul 25 12:40:29.743134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 77/146] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:29 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:29.938104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.946631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.948621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:29.949861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3c76c94c-79f1-4148-a91b-5994fbe4dd30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.229944 Jul 25 12:40:29.951472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 70/147] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:29 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:30.092450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:30.093267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:30.100454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.101008 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.101894 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.102496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.265645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:30.274747 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8958a626-fcd4-444c-a9a1-b04ad7ba2275 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.186080 Jul 25 12:40:30.275613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 78/148] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:30.526809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:30.527414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:30.534534 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.535259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.536123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.536625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.732463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:30.744346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ee277062-0e72-4058-a10c-1013989f9285 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.221679 Jul 25 12:40:30.745474 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 71/149] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:30.766493 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:30.767148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:30.775788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.777140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.778295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.779740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.979860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:30.980848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:30.985665 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:30.990135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.991084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:30.993156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:30.993820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.002861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f99d0826-6e20-4151-b659-3e0a53270970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.240028 Jul 25 12:40:31.003466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 79/150] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.241074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.253586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.255629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.257605 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-adaad704-cbf1-4c64-8065-ea393bbe52ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.285878 Jul 25 12:40:31.273120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 72/151] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:30 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:40:31.299147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.300051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.307078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.307918 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.309226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.312698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.502308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.511242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9a28db5e-a684-437f-9d24-ade869aa8f0c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.219683 Jul 25 12:40:31.511862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 80/152] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:31.774955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:31.776137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:31.780876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:31.788753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.789925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.791173 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:31.791928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:31.983586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:31.993435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-27c13771-0e8b-4420-b23a-298a480d363d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.227379 Jul 25 12:40:31.994477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 73/153] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:31 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:32.032436 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.033137 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.041549 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.042163 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.043668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.044405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.226636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:32.237789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a53f385a-4d52-4b71-8fe4-1067d4c2ef31 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.212662 Jul 25 12:40:32.238591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 81/154] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:32.279715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.280400 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.286282 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.286816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.287665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.288169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.533609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:32.534360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:32.541056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.541710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.542578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:32.543012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:32.604473 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:32.614587 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:32.616207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:32.617313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bbecde16-a56a-40e3-95c3-e1506dde7592 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.341599 Jul 25 12:40:32.618157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 74/155] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:32.683775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:32.692216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d7665fbb-1f56-45da-8fde-230c428f14cd tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.163650 Jul 25 12:40:32.692783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 82/156] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:32 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.015312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.016019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.022843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.023540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.024515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.024949 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.156580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.164562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f94f7aa0-1479-4a16-8a8e-0640522cb3eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.153221 Jul 25 12:40:33.174034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 75/157] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.269604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.269604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.269604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.269604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.270361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.270361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.397774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.405692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bf8d3f1d-39b0-40fa-99cf-f9a4f2658b37 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.149937 Jul 25 12:40:33.406357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 83/158] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:33.641092 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.641864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.648461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.648836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.649778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.650262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.654328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:33.715758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:33.716784 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:33.724809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.725714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.727314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:33.728018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:33.820510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.830005 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.832154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.833564 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b0bacb99-2a9a-48f6-a6f1-943d0a8818a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.197340 Jul 25 12:40:33.834457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 76/159] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:33.905825 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:33.913059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c8525ee5-7642-4350-a3c1-9a9a7e4fd348 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.203096 Jul 25 12:40:33.913698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 84/160] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:33 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:34.196597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.197100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:34.203325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.203772 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.204531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.204967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.348715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:34.356376 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b6d88a40-1f0f-4bd6-98d8-c3c5072bcb21 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.172714 Jul 25 12:40:34.357520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 77/161] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:34.426942 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.427541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:34.433468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.433928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.434697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.435132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.595681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:34.605058 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6982caf5-2b9b-495d-be71-2329ef7b3201 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.182117 Jul 25 12:40:34.605620 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 85/162] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:34.856827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.857637 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:34.864359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.864811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.865585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.866097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.934677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:34.935581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:34.942163 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.942645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:34.943391 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:34.943792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:35.028254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.038574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.041056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.042533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6681a9b0-576e-4175-b2a2-d156d82869f5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.189760 Jul 25 12:40:35.044149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 78/163] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:35.135679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.135679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a54a3dc1-d50a-4bd5-9156-308fd3256a1d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.201673 Jul 25 12:40:35.135679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 86/164] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:34 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:35.377900 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:35.379104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:35.385219 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:35.385669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:35.386448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:35.386877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:35.525893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.534435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3aa735a9-fc21-41ff-8d3f-74342713906b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.160082 Jul 25 12:40:35.535024 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 79/165] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:35 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:35.628345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:35.629042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:35.634873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:35.635325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:35.636066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:35.636498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:35.772644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:35.780592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-598d98a6-5396-4a25-9da5-e82ae418c406 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.156236 Jul 25 12:40:35.781189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 87/166] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:35 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:36.069959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.070558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.076680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.077150 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.077977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.078433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.155341 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.156955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.164046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.164661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.165439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.165870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.188309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:36.219515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.227869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.229647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.230705 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ac388afc-1bb5-4c8a-b506-8d238c7cde6f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.164638 Jul 25 12:40:36.231258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 80/167] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:36.300216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.307536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bbea7f04-7a77-4b18-8187-3a1f99179c07 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.156780 Jul 25 12:40:36.308103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 88/168] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:36.544627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-956930868", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "networks": [{"uuid": "f1d4b61f-f554-4201-9844-f84836207901"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:36.557107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.557709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.564385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.564833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.565606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.566063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.600444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] validate_networks() for [('f1d4b61f-f554-4201-9844-f84836207901', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:40:36.697303 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.705502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c8deb0df-84cc-406e-8cdf-089cb0391f22 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.152430 Jul 25 12:40:36.706193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 89/169] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:36.802624 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:36.803419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:36.810401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.810848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.811612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.812041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.948185 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:36.954551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:40:36.955044 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:40:36.955590 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:40:36.955687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-73856c98-8702-4808-adcd-6f1708ab9a8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.157899 Jul 25 12:40:36.956137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:40:36.956228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 90/170] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:36 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:36.956747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:40:36.970325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.970769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.971561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:36.971990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:36.989183 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Getting quotas for project 5d2fa8874dab4d3bbc87161b540ffae9. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:40:36.993545 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Getting quotas for user 0f4376954dbd4402ae5a990f1a56baf3 and project 5d2fa8874dab4d3bbc87161b540ffae9. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:40:37.004956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:40:37.007228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:40:37.053491 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-12c0d83d-356b-4c47-be68-3139c5efd431 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512583 Jul 25 12:40:37.054078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 81/171] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:40:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:40:37.065338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8409c80a-01ac-4418-a051-8371ad46185f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.066187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8409c80a-01ac-4418-a051-8371ad46185f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.123096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8409c80a-01ac-4418-a051-8371ad46185f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.130379 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8409c80a-01ac-4418-a051-8371ad46185f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1218 microversion: 2.1 time: 0.068694 Jul 25 12:40:37.130952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 91/172] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:37.258783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.259399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.266008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.266462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.267249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.267672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.332909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.333522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.340357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.340734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.342155 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.342668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.428994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.441406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.442951 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.444055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7082dcb8-056c-4e71-aabc-9f6848675ad5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.192892 Jul 25 12:40:37.451266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 82/173] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:37.509337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.517619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ed9b6c0b-eecd-41b4-ba40-18f5bcf1f445 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.193791 Jul 25 12:40:37.518225 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 92/174] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:37.726847 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.727371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.733806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.734279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.735285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.735715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.859682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:37.866947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-658ee57f-70f1-4fa4-a71f-98363558843d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.144058 Jul 25 12:40:37.867548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 83/175] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:37.976632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:37.977293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:37.983777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.984220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:37.985235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:37.985669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.112692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.120032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0f461c6f-0dc2-4270-ba27-ed589028e2f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.147298 Jul 25 12:40:38.120594 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 93/176] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:37 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:38.150805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:38.151415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:38.157821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.158299 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.159060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.159492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.222993 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.230245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7997da6c-5937-4eef-bd17-ad7ff5f6b617 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1222 microversion: 2.1 time: 0.083190 Jul 25 12:40:38.230809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 84/177] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:38 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:38.467762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:38.468358 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:38.474360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.474802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.475550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.475979 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.538776 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:38.539578 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:38.545830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.546586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.547459 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.547966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.616731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.624851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.626367 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.627456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-72f2f0e0-a380-4bb8-8797-fa5ea6b3e0ed tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.164209 Jul 25 12:40:38.628188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 94/178] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:38 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:38.689668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:38.697276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c3131f85-d282-402a-b050-480736575175 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.162526 Jul 25 12:40:38.698276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 85/179] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:38 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:38.894111 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:38.894711 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:38.900980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.901423 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:38.902195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:38.902638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.043088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.052790 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f862d912-2d43-495d-ae82-1554f1e2b4ea tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.162413 Jul 25 12:40:39.053462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 95/180] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:38 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:39.081042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-e88755fe-d46e-4849-9d38-19ed8b3a8db4 req-13364858-52a0-49c9-9084-07a3d9372d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e70f44-23c1-40de-860c-90f2398674f7", "name": "network-vif-plugged", "status": "completed", "tag": "6ecc27e1-98d7-4798-be46-819997310608"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:39.091153 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-e88755fe-d46e-4849-9d38-19ed8b3a8db4 req-13364858-52a0-49c9-9084-07a3d9372d51 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.091658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-e88755fe-d46e-4849-9d38-19ed8b3a8db4 req-13364858-52a0-49c9-9084-07a3d9372d51 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.106558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-e88755fe-d46e-4849-9d38-19ed8b3a8db4 req-13364858-52a0-49c9-9084-07a3d9372d51 service nova] Creating event network-vif-plugged:6ecc27e1-98d7-4798-be46-819997310608 for instance 29e70f44-23c1-40de-860c-90f2398674f7 on hv-cinder-82549 Jul 25 12:40:39.112243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-e88755fe-d46e-4849-9d38-19ed8b3a8db4 req-13364858-52a0-49c9-9084-07a3d9372d51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035433 Jul 25 12:40:39.112863 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 86/181] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:39.140595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.141348 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.147435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.147800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.148551 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.148983 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.254752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.255650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.262086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.262602 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.263434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.263928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.287804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.296726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fe731613-5a16-49cd-ba31-40b82bce1293 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.160491 Jul 25 12:40:39.297286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 96/182] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:39.329179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.336606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c014e9da-8442-4a5e-b020-e125a4e0ad35 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1222 microversion: 2.1 time: 0.088164 Jul 25 12:40:39.337171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 87/183] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:39.650582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.651170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.657681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.658153 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.658902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.659332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.719983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:39.720737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:39.726659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.727107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.727861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:39.728294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:39.788774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.797226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.798745 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.799834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-154a7269-8893-4042-91e4-7e87a9741b84 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.153113 Jul 25 12:40:39.800395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 97/184] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:39.857874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:39.865546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1d9b144b-7b95-43cd-9b02-33dd02cb9fa5 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.149898 Jul 25 12:40:39.866170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 88/185] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:39 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:40.074733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.075788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:40.081666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.082140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.082888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.083322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.209503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.217457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4873c2e3-ad48-46f6-a8fd-d1733af59114 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.146584 Jul 25 12:40:40.218035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 98/186] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:40 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:40.317945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.318676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:40.324466 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.324970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.325690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.326137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.358923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.359872 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:40.366068 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.366511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.367407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.367671 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.431603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.439674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3ff65d24-8743-46c4-9086-5a2908fb8f0c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1222 microversion: 2.1 time: 0.086568 Jul 25 12:40:40.440247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 99/187] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:40 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:40.460896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.468193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b4275e12-7b93-40c2-b081-b4517d6cfb21 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.154155 Jul 25 12:40:40.468745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 89/188] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:40 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:40.822179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.822772 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:40.828704 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.829138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.829878 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.830325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.885856 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:40.886400 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:40.892387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.892827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.893571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:40.894020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:40.959053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.966986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.968562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:40.969550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-102f8954-cf4d-46c4-ab22-897d85d1ef04 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.151273 Jul 25 12:40:40.970366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 100/189] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:40 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:41.023086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:41.030932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3556a38e-4a85-48d6-a271-61ad4ae34070 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.148934 Jul 25 12:40:41.031495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 90/190] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:40 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:41.238830 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.239436 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.245446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.245851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.246628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.247099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.374151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:41.381479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-93b3bc71-213f-4a81-b850-b0758e6af150 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.146746 Jul 25 12:40:41.382068 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 101/191] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:41.460811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.461436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.468746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.469192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.469984 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.470413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.488968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.489601 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.495779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.496225 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.497301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:41.497744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:41.532611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:41.540933 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a3f27b31-be92-41b4-bdab-acde74527ba7 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1222 microversion: 2.1 time: 0.083793 Jul 25 12:40:41.541872 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 91/192] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:41.641491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:41.648829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9bad3650-a3cc-4bcd-8416-f166e5d5d89e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.164083 Jul 25 12:40:41.649329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 102/193] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:41.992908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:41.993419 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:41.999908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.000340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.001078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.001501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.051170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.051925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.059293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.060312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.061071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.061495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.138457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.146592 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.148254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.149491 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-508a3e0a-0ac0-4752-ab21-c04ce884468e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.160646 Jul 25 12:40:42.150062 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 92/194] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:41 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:42.194626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.202009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b79974c7-2721-4d91-bbba-f568ed83e8a1 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.154848 Jul 25 12:40:42.202567 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 103/195] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:42 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:42.403588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.404450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.411356 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.411798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.412558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.412990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.559909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.562043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.562647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.568260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b1f9cccc-dec0-4c1e-b169-a584d33903db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.168838 Jul 25 12:40:42.568776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.569290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.569499 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 93/196] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:42 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:42.570271 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.570703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.634405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.641730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-09c4bb07-70ac-4439-819d-d19dbc3710ab tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1270 microversion: 2.1 time: 0.083663 Jul 25 12:40:42.642312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 104/197] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:42 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:42.671229 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:42.671843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:42.678014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.678460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.679224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:42.679647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:42.683091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:42.825844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:42.837975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ac7a0d0c-91bc-4f30-a28e-a1903a16c730 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1321 microversion: 2.1 time: 0.171380 Jul 25 12:40:42.852536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 94/198] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:42 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:43.170900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.171498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.177650 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.178109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.178863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.179298 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.222837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.223532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.229835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.230380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.231291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.231777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.400408 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.412755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-76031d47-d256-4812-9b42-50e2b0731a9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.193637 Jul 25 12:40:43.413421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 95/199] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:43.516446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.526185 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.527676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.528773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c6135e93-2567-4498-bf7b-bfb1744d681c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.361760 Jul 25 12:40:43.529326 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 105/200] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:43.589375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.590184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.596964 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.597406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.598191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.598622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.663132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.663858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.670720 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.671173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.671949 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.672396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.676686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:43.733061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.734014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:43.740961 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cf0de71a-5eeb-4434-86e8-521d3c816264 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.155664 Jul 25 12:40:43.741535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 96/201] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:43.743264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e4115a0d-227a-482a-8c64-530e8fc61fa6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1270 microversion: 2.1 time: 0.082706 Jul 25 12:40:43.743896 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 106/202] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:43.870721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:43.871316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:43.878360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.878798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:43.879550 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:43.879970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.009132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.017268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0e87fada-af32-4880-a1d9-e1f14a0f74b8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1514 microversion: 2.1 time: 0.150273 Jul 25 12:40:44.017860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 97/203] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:43 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:44.039420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:44.041901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.048663 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.049114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.049876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.050338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.113729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lazy-loading 'flavor' on Instance uuid 4821016c-e408-4c18-9334-8b5e11aa18d2 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:40:44.259340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-79c659b7-9f71-4755-9244-1fa932641aaa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2/action" status: 200 len: 32 microversion: 2.1 time: 0.223827 Jul 25 12:40:44.260287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 107/204] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:40:44 2022] POST /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2/action => generated 32 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:40:44.269422 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.270051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.275950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.276392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.277138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.277562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.433545 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.438718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.439558 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.442019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-540f8e96-595b-48ab-9fde-6a1dba9dcb48 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.176199 Jul 25 12:40:44.443163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 98/205] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:44.449287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.449737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.451067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.451499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.558037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.558863 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.566010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.566608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.567551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.567999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.662454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.674521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0e2aaefc-1515-4ee4-a6b7-6e996b5d51f8 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.241527 Jul 25 12:40:44.676076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 108/206] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:44.769173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.770135 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.788253 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.794471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.798686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.800092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.839992 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.850932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.852707 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.854744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b6d82da0-39b6-4c2b-a6af-e5848ff337ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.302624 Jul 25 12:40:44.855858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 99/207] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:44.861534 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:44.862388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:44.874883 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.875337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.876112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:44.876544 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:44.971734 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:44.982226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-55a217c4-6dc2-47bc-b1b8-fdbd3f020057 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1270 microversion: 2.1 time: 0.124929 Jul 25 12:40:44.985959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 100/208] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1270 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:45.022920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.034734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-350bb182-cedf-406f-958e-444f172d07ee tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.276790 Jul 25 12:40:45.035924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 109/209] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:44 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:45.465533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:45.466244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:45.472308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.472802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.473603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.474072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.673573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.684129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d774cc29-b04d-4cdd-ad54-a5f001cbe842 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.222426 Jul 25 12:40:45.684752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 101/210] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:45.701102 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:45.701707 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:45.707721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.708164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.708944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.709373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.843575 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:45.851162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-87b274b7-ff22-41a9-9003-dd64c446952c tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.155055 Jul 25 12:40:45.851726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 110/211] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:45.879028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:45.879622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:45.885604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.886087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:45.886892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:45.887352 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.004402 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.005011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.011238 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.011728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.012435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.013608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.026434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.035318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.037100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.038274 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-84053ad1-79b1-46a9-b65f-d3ac08eab980 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1407 microversion: 2.20 time: 0.163043 Jul 25 12:40:46.039361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 102/212] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:46.059921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.060540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.068699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.069142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.070728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.071167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.089471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.098882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-feff368a-49d4-4e36-a218-911edd7f7419 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1278 microversion: 2.1 time: 0.098038 Jul 25 12:40:46.099386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 111/213] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:45 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:46.275404 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.280245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e8e90293-1211-4d43-bbde-ce8777d12f5b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.224478 Jul 25 12:40:46.280815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 103/214] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:46.708343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.708947 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.715368 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.715849 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.716700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.717180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.860159 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:46.868173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bbb25e70-3f80-49bf-859d-dc440a388bc6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.164103 Jul 25 12:40:46.869009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 112/215] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:46.873266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:46.873809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:46.880021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.880570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.881221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:46.881651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:46.979641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:47.000482 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:47.021488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.029415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7011113a-2b4f-4964-b1a5-6026de479569 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.160739 Jul 25 12:40:47.029988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 104/216] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:46 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:47.062067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.062703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.068538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.068974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.069730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.070180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.119828 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.120577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.128373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.128560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:47.129173 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.130183 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.130623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.214415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.218882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.229393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f8b93a6b-d9de-4ced-b7d5-4a326f4cf67b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1276 microversion: 2.1 time: 0.113312 Jul 25 12:40:47.230172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 105/217] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:47.230600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.232738 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.233986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6ee301d9-fdc1-4276-bad8-8edcd2cb1a7e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1599 microversion: 2.20 time: 0.175891 Jul 25 12:40:47.234863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 113/218] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:40:47.259762 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.260369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.267783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.268234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.269007 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.269446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.310788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.311687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.321057 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.321589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.322649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.323158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.431795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-96238f0c-d7a8-4907-81a6-d58dfaffc896 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177531 Jul 25 12:40:47.432383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 106/219] 10.222.0.60 () {60 vars in 1316 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:40:47.778842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:47.787586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f4733c0e-0323-46c0-8b9d-b5c6b76d3d11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.488457 Jul 25 12:40:47.788485 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 114/220] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:47.891273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:47.892715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:47.901871 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.902684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:47.904480 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:47.905387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.054748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.056827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.070229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.070691 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.073317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.073998 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.539252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:48.549350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d82b0c2c-2af3-4d5e-9b2f-d1bb7ae90b30 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.662765 Jul 25 12:40:48.550367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 107/221] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:47 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:48.565675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.566319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.572259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.572895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.573835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.574437 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.620808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:48.630239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-19a60cb2-a294-4e00-a497-9c4b13a9f5cf tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1315 microversion: 2.1 time: 0.581596 Jul 25 12:40:48.630824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 115/222] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:48.678814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:48.693892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-347ddcc5-4390-4d5d-ae9f-fbde856fa815 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1276 microversion: 2.1 time: 0.142262 Jul 25 12:40:48.694788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 108/223] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:48.811751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:48.813117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:48.827309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.828623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:48.829430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:48.829863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.411857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.421265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0cec5349-d4af-460e-a081-13101f9616f7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.616445 Jul 25 12:40:49.421861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 116/224] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:48 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:49.571353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.571902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:49.579411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.580208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.581263 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.581764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.653406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.654386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:49.660939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:49.683280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.683968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.685377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:49.685808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:49.958037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:49.978447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7ca6dd88-b4d8-4942-945d-2710af19d838 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1502 microversion: 2.1 time: 0.328730 Jul 25 12:40:49.993956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 117/225] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1502 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:49.993956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:49.993956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.016021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.016525 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.017462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.018019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.030920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.038670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-30cc59be-7ee7-4dac-8ebe-2b601cafff32 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.471287 Jul 25 12:40:50.039242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 109/226] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.050676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-738cfc0d-fce4-46e1-b295-a41831bfa62f req-5b3ca21f-8b60-47ed-8367-0fed59ef0dbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:50.075902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-738cfc0d-fce4-46e1-b295-a41831bfa62f req-5b3ca21f-8b60-47ed-8367-0fed59ef0dbb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.076442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-738cfc0d-fce4-46e1-b295-a41831bfa62f req-5b3ca21f-8b60-47ed-8367-0fed59ef0dbb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.103574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-738cfc0d-fce4-46e1-b295-a41831bfa62f req-5b3ca21f-8b60-47ed-8367-0fed59ef0dbb service nova] Creating event network-changed:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:40:50.119982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-738cfc0d-fce4-46e1-b295-a41831bfa62f req-5b3ca21f-8b60-47ed-8367-0fed59ef0dbb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072469 Jul 25 12:40:50.122716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 110/227] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:50.241017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-5a8ab4f0-4b71-4955-b8f7-11e836a9090c req-759a3c25-b586-48c5-aab2-5aee62bdab7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3480c263-469e-4ba6-8104-9b8b62d02c60", "tag": "e14dd80c-9184-42a5-9866-2e89532cfb2e"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:50.254303 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5a8ab4f0-4b71-4955-b8f7-11e836a9090c req-759a3c25-b586-48c5-aab2-5aee62bdab7a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.255423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5a8ab4f0-4b71-4955-b8f7-11e836a9090c req-759a3c25-b586-48c5-aab2-5aee62bdab7a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.271775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-5a8ab4f0-4b71-4955-b8f7-11e836a9090c req-759a3c25-b586-48c5-aab2-5aee62bdab7a service nova] Creating event network-changed:e14dd80c-9184-42a5-9866-2e89532cfb2e for instance 3480c263-469e-4ba6-8104-9b8b62d02c60 on hv-cinder-82549 Jul 25 12:40:50.280036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-5a8ab4f0-4b71-4955-b8f7-11e836a9090c req-759a3c25-b586-48c5-aab2-5aee62bdab7a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045938 Jul 25 12:40:50.281746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 111/228] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:40:50.311731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.326510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-271b6e85-8edc-425b-9033-03f684548cb0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.342814 Jul 25 12:40:50.337996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 118/229] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:49 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:50.445344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:50.446930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:50.459107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.459838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.460994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:50.461617 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:50.480432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:50.727954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:50.740289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a18803c7-855d-4871-8e1b-ec3b46bc7460 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.300094 Jul 25 12:40:50.754350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 112/230] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:50 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:51.066249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:51.067563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:51.080435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.083313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.084116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.084581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.291276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:51.299818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fddbb727-2242-4d99-b5b7-eab5490b676a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.237541 Jul 25 12:40:51.301070 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 119/231] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:51 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:51.350218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:51.350845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:51.360895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.361424 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.362419 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.362843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.539319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:51.549377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bb1006f5-e8b3-43a5-8b22-f21096d278a2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.203010 Jul 25 12:40:51.550425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 113/232] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:51 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:51.755547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71e3660e-325a-48e7-ac58-c4c2ebdf5bb3"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:51.758228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:51.763458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:51.764135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:51.766215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.766724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.767526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.768006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.771423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.771966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.773343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:51.774990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:51.857500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:51.960393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:51.969962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c8c51499-e264-4db8-a4f0-5ef36a5f68c3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.211580 Jul 25 12:40:51.970742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 114/233] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:51 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:52.320591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.321844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.327945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.328387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.329149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.329615 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.481954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.490291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-df8e6207-7e75-45d3-9022-71b180b9d388 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.173406 Jul 25 12:40:52.490860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 115/234] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:52.572966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.573933 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:52.577508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:52.588346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.589060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.590188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:52.591597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:52.778941 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:52.789157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-db05f4bc-ef96-4947-85cc-a54a0a2ca100 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.219950 Jul 25 12:40:52.790243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 116/235] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:52.992013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:52.992891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.003907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.004363 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.006149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.006723 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.124382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-541beb35-3ca6-419d-ad01-01260d43af69 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "POST /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.372279 Jul 25 12:40:53.130458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 120/236] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:40:51 2022] POST /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7/os-volume_attachments => generated 194 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:53.380253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:53.393489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f62a3b0d-f1f5-4ec2-9017-85683ee905e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.405361 Jul 25 12:40:53.395035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 117/237] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:52 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:53.512735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.513609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.526836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.529469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.532382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.532994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.770000 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:53.779414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6fafbb87-e4d1-47e0-8954-d67e5c308d6d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.271970 Jul 25 12:40:53.780106 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 121/238] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:53.810454 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:53.811076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:53.817639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.818329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:53.819230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:53.819791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.295972 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.303973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d46afe3c-fee1-4cf8-9634-fb345bb0eab2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.497281 Jul 25 12:40:54.310299 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 118/239] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:53 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.417285 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:54.427861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:54.437485 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.438266 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.439285 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.439886 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.641376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.650569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-60830a41-ad16-4298-bdc1-fcb881878f23 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.236923 Jul 25 12:40:54.652244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 122/240] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:54.799861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:54.800687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:54.806658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.807270 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.808055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:54.808837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:54.951947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:54.959643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e04b30c0-9fdc-4fbd-980f-dbdaf2e06866 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.163388 Jul 25 12:40:54.960131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 119/241] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:54 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:55.328841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.329628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.338251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.338871 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.340234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.340839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.504735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:55.513548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6a4d66bb-c454-4cde-b143-fc345ecc5060 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.191569 Jul 25 12:40:55.529652 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 123/242] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:55.675910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.677752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.686446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.687160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.688114 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.689541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.866728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:55.874983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fc288a10-c81b-49f8-95b5-e1faf091e11d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.205849 Jul 25 12:40:55.875685 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 120/243] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:55.980264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:55.981048 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:55.987996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.988544 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:55.989503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:55.990117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.146325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:56.153823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-dee40a81-6082-4666-8e4e-6aa0bd4eb566 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.177315 Jul 25 12:40:56.154420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 124/244] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:55 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:56.538616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:56.539213 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:56.546050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.546493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.547330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.547817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.719195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:56.728402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d236355f-efc1-4dcf-a4b6-344a36dd7291 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.194385 Jul 25 12:40:56.730020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 121/245] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:56 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:56.900389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:56.902241 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:56.909382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.909969 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:56.911012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:56.911689 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.116353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:57.126474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ab6ade7e-0890-428f-b871-951c5b8d6555 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.230030 Jul 25 12:40:57.132637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 125/246] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:56 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:57.174820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:57.175502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:57.182412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.183091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.184123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.184686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.344136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:57.354108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-67265e1f-8f3b-4ede-a32d-782bfd9c0c72 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.183994 Jul 25 12:40:57.369582 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 122/247] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:57 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:40:57.750599 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:57.751165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:57.757090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.757532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.758313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:57.758733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:57.895547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:57.903399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-56e693ea-827e-4109-9789-4b895f6e6668 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.157211 Jul 25 12:40:57.904015 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 126/248] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:57 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:58.149648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:58.150285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:58.156105 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.156541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.157294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.157717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.291455 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:58.300532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-50aabafd-0364-491b-84d3-00e7e7ce1597 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.154622 Jul 25 12:40:58.301612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 123/249] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:58 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:58.378564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:58.379250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:58.385331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.385776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.386592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.387025 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.557346 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:58.568709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-64b7b457-4e9c-4ff5-803a-5041ddce84fb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.194428 Jul 25 12:40:58.582534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 127/250] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:58 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:58.683778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-8daca4a9-0b20-496f-b784-e8fc13b0778a req-375b6344-380c-4366-bf19-7edb039e9ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0e67fb-85b0-495f-82fa-816792a84b43", "name": "network-vif-plugged", "status": "completed", "tag": "ed8c1b70-0793-46e8-96ee-8e247d00d8a4"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:40:58.693547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8daca4a9-0b20-496f-b784-e8fc13b0778a req-375b6344-380c-4366-bf19-7edb039e9ac8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.694050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8daca4a9-0b20-496f-b784-e8fc13b0778a req-375b6344-380c-4366-bf19-7edb039e9ac8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.706527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-8daca4a9-0b20-496f-b784-e8fc13b0778a req-375b6344-380c-4366-bf19-7edb039e9ac8 service nova] Creating event network-vif-plugged:ed8c1b70-0793-46e8-96ee-8e247d00d8a4 for instance eb0e67fb-85b0-495f-82fa-816792a84b43 on hv-cinder-82549 Jul 25 12:40:58.712236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-8daca4a9-0b20-496f-b784-e8fc13b0778a req-375b6344-380c-4366-bf19-7edb039e9ac8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032111 Jul 25 12:40:58.713022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 124/251] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:40:58.924760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:58.925370 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:58.932769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.933327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:58.934260 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:58.934696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.068903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:59.076947 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6b254c58-1ea7-4fd9-8a57-ad2bad9e5b10 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.156568 Jul 25 12:40:59.077509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 128/252] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:58 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:59.322135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:59.322819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:59.329440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.329876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.330644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.331075 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.459260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:59.466471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-346c30a6-f9f0-4ae7-8c10-03caae34cecb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.148527 Jul 25 12:40:59.467026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 125/253] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:59 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:40:59.590109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:40:59.590920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:40:59.597441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.597887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.598682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:40:59.599113 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:40:59.736730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:40:59.744424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2d9267e3-b738-4cb6-b616-ea034e509be2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.158362 Jul 25 12:40:59.744983 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 129/254] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:40:59 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:00.097476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:00.098236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:00.104198 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.104656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.105447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.106515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.244723 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:00.254678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-73aef002-bc84-4209-8e75-ca988e4b3ac1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.160979 Jul 25 12:41:00.255403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 126/255] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:00 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:00.486168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:00.487353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:00.494242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.494996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.495773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.497459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.639269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:00.647381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-89f5d450-e6b3-47c3-aaaf-e4d9c3ae30e2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.165192 Jul 25 12:41:00.649984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 130/256] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:00 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:00.766155 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:00.766775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:00.772544 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.772987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.773733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:00.774186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:00.905304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:00.912652 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0c08d0b2-f8ed-4005-a1ac-11c764093200 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.150826 Jul 25 12:41:00.913209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 127/257] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:00 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:01.276090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:01.276709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:01.283214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.283657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.284419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.284862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.417244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:01.426078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9e81f679-87df-4ed9-a0f0-79d816828793 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.153610 Jul 25 12:41:01.426993 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 131/258] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:01 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:01.668526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:01.669309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:01.675628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.676146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.677002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.677414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.838193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:01.846185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3b13dc01-e1f2-4644-a752-8dc03f8dea12 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.181462 Jul 25 12:41:01.846749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 128/259] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:01 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:01.934067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:01.934707 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:01.940932 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.941375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:01.942174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:01.942606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.069313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:02.077383 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-22fca9ad-1451-42f7-8b51-ebdec583bd9a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.147253 Jul 25 12:41:02.077972 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 132/260] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:01 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:02.447577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:02.448281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:02.454342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.454858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.455672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.456100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.595939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:02.598579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:02.607114 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ab1447d3-73f1-4b01-bab2-15ee386b6b29 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.163264 Jul 25 12:41:02.607692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 129/261] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:02 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:02.870615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:02.871308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:02.878495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.879233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:02.880299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:02.881004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.055825 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:03.064878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-47afe9ab-e2cc-416a-a1a0-71a8bc5ccb0d req-0c730894-4ce2-4f57-b1ff-201686f871b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3480c263-469e-4ba6-8104-9b8b62d02c60", "name": "network-vif-plugged", "status": "completed", "tag": "e14dd80c-9184-42a5-9866-2e89532cfb2e"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:03.068114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0f30d446-fa68-41a0-81cc-2c7f61b1d97d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1365 microversion: 2.1 time: 0.203625 Jul 25 12:41:03.068874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 133/262] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:02 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:03.075238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-47afe9ab-e2cc-416a-a1a0-71a8bc5ccb0d req-0c730894-4ce2-4f57-b1ff-201686f871b8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.075804 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-47afe9ab-e2cc-416a-a1a0-71a8bc5ccb0d req-0c730894-4ce2-4f57-b1ff-201686f871b8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.089141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-47afe9ab-e2cc-416a-a1a0-71a8bc5ccb0d req-0c730894-4ce2-4f57-b1ff-201686f871b8 service nova] Creating event network-vif-plugged:e14dd80c-9184-42a5-9866-2e89532cfb2e for instance 3480c263-469e-4ba6-8104-9b8b62d02c60 on hv-cinder-82549 Jul 25 12:41:03.095528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-47afe9ab-e2cc-416a-a1a0-71a8bc5ccb0d req-0c730894-4ce2-4f57-b1ff-201686f871b8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034446 Jul 25 12:41:03.096264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 130/263] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:41:03.097529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:03.098378 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:03.104905 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.105359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.106719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.107326 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.237240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:03.244610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6d5c400e-637b-4d82-8bd0-11ee6651a31a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.151235 Jul 25 12:41:03.245210 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 134/264] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:03 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:03.628195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:03.628877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:03.635117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.635552 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.636474 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:03.636896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:03.766449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:03.773797 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bd386858-1acc-4849-918c-8f674e0ad7a0 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.149842 Jul 25 12:41:03.774401 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 131/265] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:03 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:04.090588 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:04.091173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:04.101625 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.102289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.103535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.104330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.261552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:04.265666 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:04.267191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:04.271866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-431b8d5a-58b1-4266-bd9e-4560a6489391 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1556 microversion: 2.1 time: 0.185318 Jul 25 12:41:04.273163 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 135/266] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:04 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:04.275876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.276438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.277260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.278291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.295739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:04.296454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:04.302847 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.303291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.304051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.304637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.308833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:04.560605 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:04.568313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1be6ddcc-3c67-4f1e-af55-efbdffb8303e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.307626 Jul 25 12:41:04.568891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 132/267] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:04 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:04.570278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6daf8d7c-71c2-4ee9-a97c-291da0af90cc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279404 Jul 25 12:41:04.577693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 136/268] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:41:04 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-interface => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:04.799893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:04.800514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:04.808191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.808926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.810250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:04.810959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:04.959838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:04.970321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b9fb173b-be94-412c-adc4-96e721ebdcb9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.174366 Jul 25 12:41:04.972030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 133/269] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:04 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:05.032438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:05.032996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:05.039077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.039522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.040308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.040743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.066123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:41:05.153546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-36424278-93df-4a4d-9fbc-10efd11154fc tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "DELETE /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 204 len: 0 microversion: 2.1 time: 0.124588 Jul 25 12:41:05.154240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 137/270] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:41:05 2022] DELETE /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:41:05.162137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:05.162843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:05.172193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.172934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.174592 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.175328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.319500 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:05.328379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c309bea8-0a00-41ec-b9a0-e1a3d0005f9a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1554 microversion: 2.1 time: 0.169955 Jul 25 12:41:05.329015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 134/271] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:05 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:05.588980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:05.589753 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:05.598003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.599117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.600136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.600562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.876196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:05.878526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-cc7c50cd-5800-4a07-a7f3-78ba901c0078 req-93619a9b-e4ac-4efc-a076-730972c6e53f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb0e67fb-85b0-495f-82fa-816792a84b43", "tag": "ed8c1b70-0793-46e8-96ee-8e247d00d8a4"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:05.886280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e9f7f1a7-9ec0-496f-a8cc-4bc88711880b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.301335 Jul 25 12:41:05.888608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 138/272] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:05 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:05.914839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-cc7c50cd-5800-4a07-a7f3-78ba901c0078 req-93619a9b-e4ac-4efc-a076-730972c6e53f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:05.915430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-cc7c50cd-5800-4a07-a7f3-78ba901c0078 req-93619a9b-e4ac-4efc-a076-730972c6e53f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:05.927998 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-cc7c50cd-5800-4a07-a7f3-78ba901c0078 req-93619a9b-e4ac-4efc-a076-730972c6e53f service nova] Creating event network-changed:ed8c1b70-0793-46e8-96ee-8e247d00d8a4 for instance eb0e67fb-85b0-495f-82fa-816792a84b43 on hv-cinder-82549 Jul 25 12:41:05.933088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-cc7c50cd-5800-4a07-a7f3-78ba901c0078 req-93619a9b-e4ac-4efc-a076-730972c6e53f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058142 Jul 25 12:41:05.934814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 135/273] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:05.993032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:05.993645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.009467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.009839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.010636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.011072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.174043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.185087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-157ec437-9611-44fd-9a11-824f90b113e6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.195746 Jul 25 12:41:06.186313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 139/274] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:05 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.352892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.354021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.377137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.377791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.378773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.379353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.554464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:06.570440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-93d1db9d-0b7a-435a-8d61-6372787e578a tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1554 microversion: 2.1 time: 0.222592 Jul 25 12:41:06.572824 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 136/275] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:06.908875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:06.909353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:06.916193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.916645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:06.917551 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:06.918582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.134458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.145943 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-aca75f77-9e91-4062-a299-5f89a566b1ba tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.241127 Jul 25 12:41:07.147358 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 140/276] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:06 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:07.209156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.210043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.218110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.218476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.226121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.231682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.407270 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.415029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-71168f2e-76fd-47d9-98b5-29f47eb6abb5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.210012 Jul 25 12:41:07.420275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 137/277] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:07 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:07.592917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:07.593504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:07.602742 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.603344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.604486 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:07.606493 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:07.785174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:07.794980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1aad5529-b9a2-4b96-b4b6-652f92e0d74d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1554 microversion: 2.1 time: 0.206289 Jul 25 12:41:07.795646 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 141/278] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:07 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.167138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.167970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.176294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.176764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.177552 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.178094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.312699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.320579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bde1d7f7-eebf-45a5-be7e-d69a2a67eb75 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.157280 Jul 25 12:41:08.321162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 138/279] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.439302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.439951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.446382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.446884 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.447621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.448047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.582479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.590024 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b0c7c465-c737-4446-ae7c-997407385e9f tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1318 microversion: 2.1 time: 0.154459 Jul 25 12:41:08.590596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 142/280] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:08.817373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:08.818215 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:08.825071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.825519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.826319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:08.826814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:08.983872 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:08.992305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8ff675f3-f53a-4ba7-a809-bfcba2d99b9d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1554 microversion: 2.1 time: 0.180020 Jul 25 12:41:08.992897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 139/281] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:08 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:09.344332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:09.345703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:09.352450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.352903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.353672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.354144 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.483681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:09.491589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7f3fcaf2-f5cb-49e4-ab85-98f477075299 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.151944 Jul 25 12:41:09.492173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 143/282] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:09 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:09.611533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:09.612072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:09.618204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.618654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:09.619421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:09.619852 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.013250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:10.013847 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:10.020616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.021074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.021957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.022454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.160249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:10.175748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3d9494b0-5d8f-45a9-8c14-f44c2d190387 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1507 microversion: 2.1 time: 0.568229 Jul 25 12:41:10.176404 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 140/283] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:09 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:10.187277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:10.196991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c8c51152-6882-4fb8-8d57-41bf19922b43 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1554 microversion: 2.1 time: 0.188073 Jul 25 12:41:10.197701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 144/284] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:10 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:10.525610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:10.528733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:10.539862 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.540505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.541398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.541827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.616674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-913fd8ed-c628-404c-971e-59eb74142bca req-b5514c05-88c9-42e1-a679-3a275c6d7966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e70f44-23c1-40de-860c-90f2398674f7", "name": "network-vif-deleted", "tag": "6ecc27e1-98d7-4798-be46-819997310608"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:10.633253 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-913fd8ed-c628-404c-971e-59eb74142bca req-b5514c05-88c9-42e1-a679-3a275c6d7966 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:10.633694 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-913fd8ed-c628-404c-971e-59eb74142bca req-b5514c05-88c9-42e1-a679-3a275c6d7966 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:10.651623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-913fd8ed-c628-404c-971e-59eb74142bca req-b5514c05-88c9-42e1-a679-3a275c6d7966 service nova] Creating event network-vif-deleted:6ecc27e1-98d7-4798-be46-819997310608 for instance 29e70f44-23c1-40de-860c-90f2398674f7 on hv-cinder-82549 Jul 25 12:41:10.657882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-913fd8ed-c628-404c-971e-59eb74142bca req-b5514c05-88c9-42e1-a679-3a275c6d7966 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046944 Jul 25 12:41:10.658559 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 145/285] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:41:10.716983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:10.725512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-07be29c0-794e-4efb-918f-f4a04ef53d6f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.215778 Jul 25 12:41:10.726281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 141/286] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:10 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:11.227272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:11.227974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:11.234176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.234890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.235647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.236081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.296963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:11.304808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a2d32c11-13b1-4a86-8b4f-0dcce57ae73f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1512 microversion: 2.1 time: 0.081825 Jul 25 12:41:11.305373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 146/287] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:11 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1512 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:11.746815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:11.747987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:11.753850 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.754330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.755084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:11.755517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:11.884163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:11.891468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-73cbc94b-6e07-4628-9d87-29365c285e26 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.148637 Jul 25 12:41:11.892031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 142/288] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:11 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:12.325816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:12.326447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:12.332834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.333275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.334050 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.334476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.396820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:12.404607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-58bec840-846e-4a80-b14a-957516c65761 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1512 microversion: 2.1 time: 0.082644 Jul 25 12:41:12.405156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 147/289] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:12 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:12.912475 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:12.913073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:12.918927 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.919367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:12.920387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:12.920815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.047102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:13.054450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8af06bf6-852e-4abc-ac28-e2a1e3bb5937 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.145763 Jul 25 12:41:13.055017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 143/290] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:12 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:13.424405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:13.425008 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:13.431408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.431853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.432604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:13.433064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:13.498044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:13.505963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f7029f76-8f3e-4770-8ee4-e3ae1773b2cb tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1512 microversion: 2.1 time: 0.085404 Jul 25 12:41:13.506533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 148/291] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:13 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1512 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:14.075178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:14.075839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:14.081792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.082262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.083010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.083437 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.219086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:14.226526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f982a147-d6c9-409c-aec4-d5fbdf4cd32a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.155176 Jul 25 12:41:14.227081 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 144/292] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:14 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:14.528246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:14.528852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:14.535349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.535796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.536557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:14.537002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:14.598635 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:14.607040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ebebc1f2-18c5-4029-bf5a-fcdfd1a4d59f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1512 microversion: 2.1 time: 0.083202 Jul 25 12:41:14.607624 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 149/293] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:14 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1512 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:15.248725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:15.249331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:15.255458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.255903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.256652 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.257081 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.387741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:15.395502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b5cdf339-1429-4529-8d23-ab71b2568501 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.151218 Jul 25 12:41:15.396064 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 145/294] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:15 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:15.627848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:15.628456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:15.635010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.635442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.636197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:15.636633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:15.702405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f3576844744c538a4755221c4added', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c24e32d2fb6e4a3db413acc06528d15e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:15.711795 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d7a7bca1-a5ab-400a-b3e3-6c6858d0590b tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 200 len: 1346 microversion: 2.1 time: 0.087708 Jul 25 12:41:15.712364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 150/295] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:15 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:16.416188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:16.416788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:16.422753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.423190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.423939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.424361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.581588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:16.589168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-20e5793c-c614-4d4b-8c0b-c9a53e0cf03b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.176750 Jul 25 12:41:16.589774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 146/296] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:16 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:16.735215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:16.736011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:16.743010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.743591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.744460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.744994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.779083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] HTTP exception thrown: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Request method failure captured: Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 HTTP/1.1 Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8SyZuwH32GXxD-VKzQJdClVP4NGhdNd3kVrDt74JxbhQe0grvFqwmNY2a9RANxXjK4D01WEaKy_esunG1ebjLM95Zbv_lYt5Yt0Eeyp4BSxI_lNLv5i4lpuu_ZJBXjrX1xkgyStw4nP_2Rm6fm_ujmpFTFyxwOvAlTlR51qvSWtuA Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:41:16.783842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: b0f3576844744c538a4755221c4added Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.785327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '29e70f44-23c1-40de-860c-90f2398674f7'} Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:16.787929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.789954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.791393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Returning 404 to user: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:16.791393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-67f7c0a5-b373-46c4-aef8-1de68c92e52d tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 404 len: 111 microversion: 2.1 time: 0.056682 Jul 25 12:41:16.791393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 151/297] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:16 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:16.925897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:16.929393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:16.937464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.938193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.938976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:16.939407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:16.953430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] HTTP exception thrown: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Request method failure captured: Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7/os-volume_attachments HTTP/1.1 Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8SyZuwH32GXxD-VKzQJdClVP4NGhdNd3kVrDt74JxbhQe0grvFqwmNY2a9RANxXjK4D01WEaKy_esunG1ebjLM95Zbv_lYt5Yt0Eeyp4BSxI_lNLv5i4lpuu_ZJBXjrX1xkgyStw4nP_2Rm6fm_ujmpFTFyxwOvAlTlR51qvSWtuA Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:41:16.963750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: b0f3576844744c538a4755221c4added Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.965011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'server_id': '29e70f44-23c1-40de-860c-90f2398674f7'} Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:16.965655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:16.966910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:16.968982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Returning 404 to user: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:16.968982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3ffaca4d-b6d4-4c5d-b88c-430403382c72 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040962 Jul 25 12:41:16.968982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 147/298] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:41:16 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:17.610012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:17.610619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:17.616735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.617180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.617945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:17.618383 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:17.745721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:17.749714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:17.754751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-39fb13f0-78cb-4dbd-8d7f-245ff972b3ca tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.148991 Jul 25 12:41:17.755307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 152/299] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:17 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:18.775971 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:18.776574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:18.783230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.783671 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.784425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:18.784851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:18.800396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:18.919607 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:18.927729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-93182532-e9bb-47f7-a69a-aa36c33857c9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.155504 Jul 25 12:41:18.928295 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 148/300] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:18 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:19.316020 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.316596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:19.324103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.324550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.325906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.326456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.340592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] HTTP exception thrown: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Request method failure captured: Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 HTTP/1.1 Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8SyZuwH32GXxD-VKzQJdClVP4NGhdNd3kVrDt74JxbhQe0grvFqwmNY2a9RANxXjK4D01WEaKy_esunG1ebjLM95Zbv_lYt5Yt0Eeyp4BSxI_lNLv5i4lpuu_ZJBXjrX1xkgyStw4nP_2Rm6fm_ujmpFTFyxwOvAlTlR51qvSWtuA Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:41:19.342214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: b0f3576844744c538a4755221c4added Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.343407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '29e70f44-23c1-40de-860c-90f2398674f7'} Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:19.344139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.345187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.346350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Returning 404 to user: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:19.346350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e8c6ed4f-c779-4ad7-9dec-c74e4b0308d3 tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "DELETE /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 404 len: 111 microversion: 2.1 time: 0.031804 Jul 25 12:41:19.346350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 153/301] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:41:19 2022] DELETE /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:19.352457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.353067 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] [instance: 29e70f44-23c1-40de-860c-90f2398674f7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:19.359309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.360012 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.360788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.361380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.376182 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] HTTP exception thrown: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Request method failure captured: Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 HTTP/1.1 Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8SyZuwH32GXxD-VKzQJdClVP4NGhdNd3kVrDt74JxbhQe0grvFqwmNY2a9RANxXjK4D01WEaKy_esunG1ebjLM95Zbv_lYt5Yt0Eeyp4BSxI_lNLv5i4lpuu_ZJBXjrX1xkgyStw4nP_2Rm6fm_ujmpFTFyxwOvAlTlR51qvSWtuA Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:41:19.378359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c24e32d2fb6e4a3db413acc06528d15e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c24e32d2fb6e4a3db413acc06528d15e Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-DeleteServersTestJSON-11963992 Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: b0f3576844744c538a4755221c4added Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-DeleteServersTestJSON-11963992-project Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.380294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '29e70f44-23c1-40de-860c-90f2398674f7'} Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:19.380944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. Jul 25 12:41:19.382071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:19.383049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] Returning 404 to user: Instance 29e70f44-23c1-40de-860c-90f2398674f7 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:19.383049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-151160fd-da74-4b90-b6c1-a473e1e2936f tempest-DeleteServersTestJSON-11963992 tempest-DeleteServersTestJSON-11963992-project] 10.222.0.60 "GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7" status: 404 len: 111 microversion: 2.1 time: 0.031126 Jul 25 12:41:19.383049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 149/302] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/servers/29e70f44-23c1-40de-860c-90f2398674f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:41:19.949084 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:19.949630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:19.952105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:19.957211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.957659 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:19.958474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:19.958909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:20.181371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:20.189783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0607eae2-07cb-4218-b38d-231dbadf3409 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.244546 Jul 25 12:41:20.190273 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 154/303] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:19 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:21.211526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:21.212190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:21.219281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.219736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.220504 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:21.220934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:21.657803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:21.665565 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-de85bd8f-e904-4c0c-816d-2e806eba9468 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.458151 Jul 25 12:41:21.666386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 150/304] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:21 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:22.688839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:22.689485 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:22.698148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.699028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:22.700096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:22.701209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:23.020737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:23.042185 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2eba2923-70a2-41b4-bc3f-e0e8c7a6ec7f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.358204 Jul 25 12:41:23.045946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 155/305] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:22 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:24.083829 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:24.084526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:24.086736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=70 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:24.092556 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:24.092990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:24.094319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:24.095086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:24.351808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:24.366685 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a7ad120e-ba39-4694-9e03-2b73b9a87ab1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.296797 Jul 25 12:41:24.367989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 151/306] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:24 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:25.388843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:25.389590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:25.402372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.402821 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.404145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:25.404573 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:25.572125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:25.581642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c3f81226-99ef-48c4-a10e-5b8ba33cd430 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.197490 Jul 25 12:41:25.582327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 156/307] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:25 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:26.603207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:26.603887 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:26.611159 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.611701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:26.612550 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:26.613043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:26.747934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:26.755485 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c37f60da-5f55-4e7b-9a39-b8d728c1208d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.155991 Jul 25 12:41:26.756050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 152/308] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:26 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:27.776160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:27.776779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:27.783311 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.784104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.785046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:27.785803 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:27.949642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:27.959156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5b897fdb-4544-4dbf-8e94-53883e89b7e8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.186697 Jul 25 12:41:27.962324 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 157/309] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:27 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:28.982460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:28.983060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:28.989290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.989730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:28.990512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:28.990941 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:29.126140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:29.133773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6fb38baf-c767-4333-a084-05a697ed6a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.154905 Jul 25 12:41:29.134189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:28 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:30.158159 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:30.159797 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:30.171848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.172564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:30.173699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:30.174362 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:30.333385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:30.342626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3e80eb32-a953-4bb6-a9e2-c72982e04abd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.188805 Jul 25 12:41:30.343175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 158/311] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:30 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:31.364523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:31.365177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:31.371865 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.372682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.377702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:31.378511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:31.586202 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:31.594101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-81050817-2b22-45ee-9c31-d575b50aeaee tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.234395 Jul 25 12:41:31.594668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:31 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:32.615400 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:32.616005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:32.622884 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.623323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.624072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:32.624501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:32.769015 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:32.776693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-09856b0f-b11e-42c7-9130-14690b99397c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.164998 Jul 25 12:41:32.777265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 159/313] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:32 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:33.798838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:33.799445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:33.805984 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.806631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.808010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:33.808436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:33.968641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:33.976118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-29ff926f-5cfc-4b12-9e98-f03331b60bda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.181005 Jul 25 12:41:33.977352 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 155/314] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:33 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:34.997804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:34.998438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:35.005017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.005490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.006282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:35.006717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:35.201243 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:35.212197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5f5e326d-5adb-4589-ae62-ceddddc1ba2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.218450 Jul 25 12:41:35.212960 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 160/315] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:34 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:36.233498 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:36.234282 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:36.241492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.242217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.243107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:36.243852 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:36.412143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:36.421810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8106583d-faf1-45fa-b3ae-ee19965f3b08 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.193033 Jul 25 12:41:36.422427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:36 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:37.443545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:37.444315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:37.451582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.452106 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.452945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:37.453452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:37.599311 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:37.608262 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7a5facbe-ba90-4215-9aed-837a648cdbe4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.168849 Jul 25 12:41:37.608817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 161/317] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:37 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:38.632378 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:38.633628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:38.644031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.644668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.645639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:38.648844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:38.816838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:38.827224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-97dfb387-f835-49bc-905c-5e3b30d902ff tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1520 microversion: 2.1 time: 0.200328 Jul 25 12:41:38.828268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 157/318] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:38 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:39.849857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:39.850490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:39.857607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.858381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:39.859247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:39.859886 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.054203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:40.063252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a2633d76-3392-41f2-873e-a626a1a59fc3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1500 microversion: 2.1 time: 0.218446 Jul 25 12:41:40.064154 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 162/319] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:39 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1500 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:41:40.083545 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:40.084151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:40.090273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:40.090988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.091744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:40.092497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:40.286882 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:40.295777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ab81c3ae-4962-4701-9ba2-e2fd627b5c14 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1514 microversion: 2.1 time: 0.215947 Jul 25 12:41:40.296355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 158/320] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:40 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:42.789595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:42.791832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:42.798973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.799366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.800127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.800563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.822078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lazy-loading 'flavor' on Instance uuid 21a2d814-e80f-4925-a7b9-079437015ea9 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:41:42.898321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-af2d156d-1c35-42f2-8b34-6012b80e1856 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/action" status: 200 len: 32 microversion: 2.1 time: 0.112614 Jul 25 12:41:42.899282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 163/321] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:42 2022] POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:41:42.909469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:42.910195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:42.916458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.916988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:42.917903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:42.918626 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:43.131237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:43.139336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-01a6923e-6262-4d0b-b679-726dd4129cf3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.233669 Jul 25 12:41:43.139894 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 159/322] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:42 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:44.162488 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:44.163101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:44.171095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.171776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.172791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:44.173225 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:44.306490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:44.313771 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7d38f1f7-0bbd-410b-8d05-a730e03a8bb4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.155611 Jul 25 12:41:44.314359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 164/323] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:44 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:45.337015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:45.337884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:45.343986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:45.344501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:45.345434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:45.345940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:45.486350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:45.493762 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3500e322-ef65-43dd-977b-61adcb010c8a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.161664 Jul 25 12:41:45.494354 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 160/324] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:45 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:46.517012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:46.517653 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:46.524649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.525101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.525889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:46.526339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:46.684590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:46.700636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3d67254c-e92c-4363-bfe0-4ae988d41a4f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.188112 Jul 25 12:41:46.701470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 165/325] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:46 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:47.722374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:47.722996 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:47.729245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.729687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.730481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:47.730915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:47.865210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:47.873676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f5c64987-874f-40ef-a7b7-e9a436125e2c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.154754 Jul 25 12:41:47.874340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 161/326] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:47 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:48.896257 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:48.896856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:48.903336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:48.903818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:48.904574 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:48.905004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:49.042515 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:49.049845 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-40789010-0be8-4671-b6a9-b9912bd094d1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.157482 Jul 25 12:41:49.050429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 166/327] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:48 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:50.070523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:50.071136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:50.077550 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:50.078033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:50.078801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:50.079238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:50.081901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=78 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:50.210742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:50.219190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d5b25c24-603b-47dc-bae4-027e22cea10e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.152380 Jul 25 12:41:50.219944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 162/328] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:50 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:51.240778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:51.241401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:51.243813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=26 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:51.249049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.250172 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:51.250928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:51.251352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:51.254018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:51.387857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:51.395259 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d74a5337-d32d-468b-bca2-424ee23d586c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.158371 Jul 25 12:41:51.395851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 167/329] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:51 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:52.418126 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:52.418738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:52.424681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:52.425123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:52.425876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:52.426330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:52.553334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:52.561165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5c99c485-abc3-4252-ab67-790e00be5832 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.146339 Jul 25 12:41:52.566060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 163/330] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:52 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:53.582696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:53.583330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:53.589329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:53.589779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:53.590572 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:53.591006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:53.724051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:53.731439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d1388bf2-ca42-407b-a49a-531a806b8e49 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.152871 Jul 25 12:41:53.731999 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 168/331] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:53 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:54.752644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:54.753257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:54.755129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=26 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:54.760315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:54.760758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:54.761512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:54.761960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:54.889293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:54.897342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9a351a93-b3ef-4576-a123-e4c82fd5d7ef tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.148512 Jul 25 12:41:54.897933 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 164/332] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:54 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:55.921675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:55.922296 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:55.928851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.929284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:55.930087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:55.930512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:56.054696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:56.062187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-dd32ca2c-7727-4643-afa0-c60af326fa89 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.144813 Jul 25 12:41:56.062743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 169/333] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:55 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:57.082714 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:57.083506 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:57.089518 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:57.089987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:57.090739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:57.091163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:57.280262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:57.287802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fe245e0d-7388-4846-b694-51b2f315b5f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.208894 Jul 25 12:41:57.288377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 165/334] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:57 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:58.309849 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:58.310483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:58.318521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:58.318969 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:58.319739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:58.320173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:58.454709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:58.462364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2aadb995-ce3f-45f9-aaed-0d4e3c177d86 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.156233 Jul 25 12:41:58.470988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 170/335] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:58 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:59.483035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:59.483587 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:59.489768 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.490236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.490979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.491410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.563296 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21872262-cfef-4c40-a881-9b3505db8dce", "device": "/dev/sdb"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:59.568010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:59.575860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.576752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.577629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.578817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.629903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:41:59.638426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1debf390-277d-4b8c-b70f-43db66fe43a0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1500 microversion: 2.1 time: 0.159235 Jul 25 12:41:59.639315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 166/336] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:59 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:41:59.665170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de6c28fb-aff0-4884-92a6-fceb6d96186b"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:59.667581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:59.674877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.675330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.678208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.678208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.707790 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] HTTP exception thrown: Cannot 'attach_volume' instance 21a2d814-e80f-4925-a7b9-079437015ea9 while it is in vm_state rescued Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Request method failure captured: Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/os-volume_attachments HTTP/1.1 Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 74 Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8EmIKYVgzQNF9TKVx9CaU6EWQ9y_NXh7bqWeTEpX86Zj-l1LZHIAB537TxjOMD1kS8BKaoM-y0h1BR7YQeZvIYghVXBTComBdqNksuv2OU6X3Dv4ZngkRBOXNAPKBDSUM_JlFtoFHt0Lg8pBZmGmmkJ8yFs8crUHtCVth7L421EUY Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:41:59.709446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b0ca10639aa47dea81db9799273acba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: e56531920fc548a3a37f63ca0d1e5d82 Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {"volumeAttachment": {"volumeId": "de6c28fb-aff0-4884-92a6-fceb6d96186b"}} Jul 25 12:41:59.710890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Cannot 'attach_volume' instance 21a2d814-e80f-4925-a7b9-079437015ea9 while it is in vm_state rescued Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'server_id': '21a2d814-e80f-4925-a7b9-079437015ea9', 'body': {'volumeAttachment': {'volumeId': 'de6c28fb-aff0-4884-92a6-fceb6d96186b'}}} Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:41:59.711629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 21a2d814-e80f-4925-a7b9-079437015ea9 while it is in vm_state rescued Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:41:59.716668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 21a2d814-e80f-4925-a7b9-079437015ea9 while it is in vm_state rescued Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Returning 409 to user: Cannot 'attach_volume' instance 21a2d814-e80f-4925-a7b9-079437015ea9 while it is in vm_state rescued {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-db66ba45-ee93-4d83-9ce8-74ef29da53f9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055233 Jul 25 12:41:59.717749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 167/337] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:41:59 2022] POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 12:41:59.723528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:41:59.724131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:59.733888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.734563 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.735511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.735949 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.814411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e080793d-5cdf-47bf-9826-3fb6f40dc0c0 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/action" status: 202 len: 0 microversion: 2.1 time: 0.096944 Jul 25 12:41:59.815031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 168/338] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:41:59 2022] POST /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:41:59.824740 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:41:59.825428 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:41:59.832728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.833390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.834402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:41:59.835839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:41:59.879435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4f0d097d-e3f2-45d1-aeeb-dd7c3e321d0b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "POST /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320766 Jul 25 12:41:59.880243 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 171/339] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:41:59 2022] POST /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:42:00.074229 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:00.082897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-52a895d9-bdc5-4016-b97c-a99a27fab398 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.262113 Jul 25 12:42:00.083890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 169/340] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:41:59 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:01.104460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:01.105396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:01.113140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.113592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.114421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:01.114858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:01.249263 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:01.263414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e6920352-bf57-4a66-98a5-f7edd1939ee3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.162993 Jul 25 12:42:01.264290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 172/341] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:01 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:02.284600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:02.285204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:02.291460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.291908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.292659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:02.293094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:02.422717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:02.430687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-70f287c7-7395-44d0-87b9-0f92b7697381 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.149970 Jul 25 12:42:02.431238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 170/342] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:02 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:03.451689 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:03.452240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:03.459350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.459794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.460553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:03.460984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:03.585430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:03.592761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-35a68c8a-5dd7-46d0-9a16-76af626d210d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.144996 Jul 25 12:42:03.593315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 173/343] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:03 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:04.613604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:04.614251 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:04.620166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.620618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.621377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:04.621814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:04.882426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:04.889681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-276774b0-e8ec-41cc-aab1-fa16eec30378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.280263 Jul 25 12:42:04.890281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 171/344] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:04 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:05.911632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:05.912235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:05.918661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.919110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:05.919863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:05.920293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:06.053674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:06.061019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-96bf94f3-2e4b-4384-99ca-2d0bb0036b07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.153765 Jul 25 12:42:06.061571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 174/345] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:05 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:07.083493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:07.084092 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:07.090113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.090553 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.091298 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:07.091724 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:07.220101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:07.227411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9766bcdb-6c50-433d-8bba-38f32cf853f7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.149503 Jul 25 12:42:07.227964 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 172/346] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:07 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:08.249420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:08.250051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:08.257074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.257512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.258290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:08.258718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:08.392647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:08.399939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d96551f3-e823-4dc3-b83c-c66a0cdf4853 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.154318 Jul 25 12:42:08.400513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 175/347] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:08 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:09.420442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:09.421106 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:09.427011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.427462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.428218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:09.428656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:09.556269 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:09.564172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6dedc096-60e9-4a7d-aa6e-df15941a16ed tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.147041 Jul 25 12:42:09.564726 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 173/348] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:09 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:10.584916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:10.585517 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:10.591863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.592302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.593053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:10.593483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:10.731789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:10.740033 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5919868a-0373-4feb-a323-19a0ce6276d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.158947 Jul 25 12:42:10.740583 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 176/349] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:10 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:11.761436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:11.762084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:11.768649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.769091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.769855 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:11.770383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:11.918649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:11.926116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5fbcb540-14dd-4921-bece-58dbb9b95378 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1508 microversion: 2.1 time: 0.168361 Jul 25 12:42:11.926886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 174/350] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:11 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:12.948110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:12.948649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:12.955743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.956187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:12.956948 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:12.957379 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:13.084021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:13.092071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e2e9e3a1-bd6c-4a98-9119-a8480ea30a76 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1514 microversion: 2.1 time: 0.147906 Jul 25 12:42:13.092829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 177/351] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:12 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:15.498328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-631cd826-fd93-4905-b282-aa2f07bbd82f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: .version_select at 0x7f4c2d6e8550>, body: {"keypair": {"name": "tempest-keypair-278752416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ll2F/eYGPlhb92lIAf0PRtEvDX7PGUzwgPz/CDjdcDfz9ZlfFY0fKgERPKDJ2LthggBCCg8i9OBGhZO10yG7tsIgsd0asH8ak3FMtijq/AR7VH+VeNfO9HGFyo1gObQ=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:15.516359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-631cd826-fd93-4905-b282-aa2f07bbd82f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for project 3b0ca10639aa47dea81db9799273acba. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:15.522521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-631cd826-fd93-4905-b282-aa2f07bbd82f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for user e56531920fc548a3a37f63ca0d1e5d82 and project 3b0ca10639aa47dea81db9799273acba. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:15.557073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-631cd826-fd93-4905-b282-aa2f07bbd82f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062514 Jul 25 12:42:15.557658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 175/352] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:42:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:17.190093 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-181789613", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f36add4-a98d-4ec2-a004-7819cfb577b7"}], "security_groups": [{"name": "tempest-securitygroup--255539379"}], "key_name": "tempest-keypair-278752416", "user_data": "}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:17.317233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] validate_networks() for [('9f36add4-a98d-4ec2-a004-7819cfb577b7', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:17.776055 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:17.776477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:17.776951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:17.777559 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:17.777994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:17.787219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.787668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.788467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:17.788899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:17.806308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:17.810344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Getting quotas for user e56531920fc548a3a37f63ca0d1e5d82 and project 3b0ca10639aa47dea81db9799273acba. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:17.824282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:17.826758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:17.878071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0b70df36-8372-4c28-811c-690399d01cdd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.692950 Jul 25 12:42:17.882079 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 178/353] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:17.895371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7a0fd278-3fda-4865-aa39-394f7c7e5465 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:17.900094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7a0fd278-3fda-4865-aa39-394f7c7e5465 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:17.978039 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7a0fd278-3fda-4865-aa39-394f7c7e5465 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:17.985943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7a0fd278-3fda-4865-aa39-394f7c7e5465 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1244 microversion: 2.1 time: 0.098163 Jul 25 12:42:17.986545 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 176/354] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:17 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:19.010857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:19.011862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:19.022598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.023111 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.024099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:19.024845 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:19.115925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:19.124093 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4a877333-f709-461a-90dd-f716b8a8a9d8 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.119532 Jul 25 12:42:19.124721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 179/355] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:19 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:20.146977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:20.148273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:20.155319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.156016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.156941 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:20.158035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:20.162162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:20.226370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:20.233782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-460e792a-5036-47ad-a98b-680af2e6edc7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.093133 Jul 25 12:42:20.234656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 177/356] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:20 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:21.254919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:21.255526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:21.258204 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:21.266731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.267320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.268095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:21.268524 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:21.284594 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:21.345728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:21.354077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2e6ce588-b7f1-4b43-b229-7eb8fc8e4bc9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.103891 Jul 25 12:42:21.355077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 180/357] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:21 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:22.375481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:22.376621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:22.382722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.383170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.384154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:22.384592 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:22.476421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:22.484117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ba6c2e3a-9427-4b2a-838d-25b5f3e3dbe9 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.112337 Jul 25 12:42:22.486900 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 178/358] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:22 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:23.508695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:23.509470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:23.516176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.516676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.517453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:23.518018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:23.587037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:23.595655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4e173ab0-b9bb-4762-ac55-1eb67009aec5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.090779 Jul 25 12:42:23.596567 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 181/359] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:23 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:24.632800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:24.633436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:24.645431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.654240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.655281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:24.655734 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:24.731006 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:24.740027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9dd5ce62-32a6-4ae0-a311-e9203c00ad8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1248 microversion: 2.1 time: 0.121075 Jul 25 12:42:24.740997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 179/360] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:24 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:25.761164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:25.762387 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:25.780560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.783035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.785231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:25.786649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:25.919411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:25.952914 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ae6fa185-8f17-4399-a251-f2b005c4564b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1240 microversion: 2.1 time: 0.194953 Jul 25 12:42:25.966939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 182/361] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:25 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1240 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:26.978904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:26.980380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:26.992742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:27.001870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.002509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.003191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:27.003628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:27.152079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:27.161667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6dc7f6af-ee92-4ddc-af4b-b9cfa2dd589a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1302 microversion: 2.1 time: 0.186457 Jul 25 12:42:27.162336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 180/362] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:26 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1302 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:28.185036 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:28.185893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:28.202381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:28.203611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:28.206000 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.206443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.207598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:28.208227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:28.289755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:28.299659 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e3aa76db-4acf-4b32-a36b-a5310d0457bc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1302 microversion: 2.1 time: 0.119706 Jul 25 12:42:28.301081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 183/363] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:28 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:29.321947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:29.323392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:29.325496 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:29.332154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.333100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.334152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.334805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.475727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-a32a6419-cba4-4ac9-8349-cb05736e8b20 req-7b420b0b-1553-4645-a078-1006b39e8430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:29.491960 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a32a6419-cba4-4ac9-8349-cb05736e8b20 req-7b420b0b-1553-4645-a078-1006b39e8430 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:29.492660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a32a6419-cba4-4ac9-8349-cb05736e8b20 req-7b420b0b-1553-4645-a078-1006b39e8430 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:29.512393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-a32a6419-cba4-4ac9-8349-cb05736e8b20 req-7b420b0b-1553-4645-a078-1006b39e8430 service nova] Creating event network-changed:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:42:29.519633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-a32a6419-cba4-4ac9-8349-cb05736e8b20 req-7b420b0b-1553-4645-a078-1006b39e8430 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049585 Jul 25 12:42:29.521102 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 184/364] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:29.624441 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:29.633184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e55d0ef5-b832-46e2-bcdc-3fcd6f7c2d78 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.314983 Jul 25 12:42:29.639379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 181/365] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:29 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:30.657788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:30.659345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:30.682897 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.684841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.687493 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:30.690158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:30.920971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:30.932676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ffc18e6b-03cb-4ec8-b71f-c098125f4865 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.280654 Jul 25 12:42:30.933261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 185/366] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:30 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:31.970841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:31.971611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:31.987519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.988319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:31.991278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:31.998914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:32.298009 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:32.306008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1481e7be-a1c8-4e8e-8ac8-c9dfc4f43dd7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.354084 Jul 25 12:42:32.306870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 182/367] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:31 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:33.329378 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:33.330009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:33.336934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.337591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.338543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:33.339125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:33.511873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:33.526497 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-385890a4-d281-4eca-ae55-679baed37cbb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.202288 Jul 25 12:42:33.539151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 186/368] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:33 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:34.553207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:34.554509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:34.567518 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.568268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.569234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:34.569828 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:34.763009 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:34.771144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8905fb7b-edb7-4c9f-bd30-8afe415afffa tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.221622 Jul 25 12:42:34.781939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 183/369] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:34 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:35.795546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:35.796136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:35.805095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.805819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.806825 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:35.807534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:35.978714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:35.989022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5b904952-2812-4f73-b041-5a66550deabf tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.196780 Jul 25 12:42:35.992347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 187/370] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:35 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:37.012672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:37.013222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:37.022520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.023251 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.024360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:37.024977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:37.166895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:37.179367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0c985194-a180-4ee1-abee-abb169676f18 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.170558 Jul 25 12:42:37.199083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 184/371] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:37 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:38.200669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:38.201437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:38.208661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.209108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.209870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:38.210326 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:38.380131 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:38.388189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-548df11c-6ac0-46ec-a8b8-c720523d926b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.191381 Jul 25 12:42:38.389700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 188/372] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:38 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:38.752771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-39989f24-bd75-44ef-a1bf-8930cdf50862 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'create', calling method: .version_select at 0x7f4c2d6e8af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1019509300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAy9e4mKDIfrUMkfy41r+RIcgxUt+mJIXFF9Br/tu97kXNHB04olqwMaLzxves1eWFFj88aWIUgQ41vbst+zFR0AbtmcCkgotu/nVW74BaXCYs7QPg0wX9p7FOoAZixEkg=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:38.767543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-39989f24-bd75-44ef-a1bf-8930cdf50862 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Getting quotas for project 8260111bf70a4afab166caf5a4881931. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:38.771194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-39989f24-bd75-44ef-a1bf-8930cdf50862 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Getting quotas for user f5032f6d4f074cae838066344fcea598 and project 8260111bf70a4afab166caf5a4881931. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:38.793407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-39989f24-bd75-44ef-a1bf-8930cdf50862 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.044509 Jul 25 12:42:38.794184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 185/373] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:42:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:38.903416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2008272148", "imageRef": "6ca0c6d5-40f7-4171-b341-9bd212a6aa5c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1019509300", "networks": [{"uuid": "e3a72224-528e-4a69-b7ad-c2fae3886ba0"}]}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:38.958661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] validate_networks() for [('e3a72224-528e-4a69-b7ad-c2fae3886ba0', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:42:39.332926 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:42:39.333427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:42:39.333796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:42:39.334279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:42:39.334726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:42:39.344175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.344613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.345399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.345831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.362274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Getting quotas for project 8260111bf70a4afab166caf5a4881931. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:42:39.367278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Getting quotas for user f5032f6d4f074cae838066344fcea598 and project 8260111bf70a4afab166caf5a4881931. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:42:39.379542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:42:39.381739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ca0c6d5-40f7-4171-b341-9bd212a6aa5c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:42:39.411261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:39.412118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:39.419340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.420048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.420802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:39.421225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:39.428846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ed551745-e8f6-43f0-87b4-239e747a5a7f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529215 Jul 25 12:42:39.429820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 189/374] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:42:39.442216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-16da6265-34a4-453f-ad43-60bb6ca0948a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:39.443168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-16da6265-34a4-453f-ad43-60bb6ca0948a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:39.509260 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-16da6265-34a4-453f-ad43-60bb6ca0948a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.516807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-16da6265-34a4-453f-ad43-60bb6ca0948a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1259 microversion: 2.1 time: 0.079638 Jul 25 12:42:39.517383 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 190/375] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:39 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:39.573223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:39.581698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-57e65964-d17e-4bae-8e5d-06b47d390b65 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.174720 Jul 25 12:42:39.582186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 186/376] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:39 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:40.541132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:40.541784 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:40.548917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.549350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.550125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.550552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.602420 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:40.603017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:40.608969 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.609672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.610236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.610449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:40.610879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:40.617630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0f194e4c-534e-4baf-ba8e-174e42bedd42 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.080486 Jul 25 12:42:40.618231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 191/377] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:40 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:40.739514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:40.746826 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ca5873e4-aeb1-41dc-a8cc-db5577560896 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.148334 Jul 25 12:42:40.747379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 187/378] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:40 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:41.637107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:41.637746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:41.644176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.644619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.645374 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.645807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.705141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:41.712387 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-01075501-3bf6-4491-955a-9a6dbc1af7ac tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.079069 Jul 25 12:42:41.712950 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 192/379] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:41 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:41.767184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:41.767832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:41.773781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.774248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.775002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:41.775431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:41.899444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:41.907385 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-777881b2-1b3e-4196-ae49-7f21eed1f89c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.143963 Jul 25 12:42:41.907947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 188/380] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:41 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:42.733434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:42.733999 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.740770 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.741211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.741977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.742410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.800758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:42.808022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c9cdd3e4-856a-4605-8aa1-55791926ea65 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.078451 Jul 25 12:42:42.808572 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 193/381] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:42 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:42.928743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:42.929405 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:42.935239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.935797 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:42.936553 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:42.937007 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.088795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.097322 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-24f69767-12dc-4095-8a84-0910f02dace7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.172529 Jul 25 12:42:43.098016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 189/382] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:42 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:43.829084 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:43.830231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:43.836634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.837071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.837815 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:43.838265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:43.899470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:43.906641 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ec54008f-81a8-4bb7-8d23-3aff3ddaf230 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.081419 Jul 25 12:42:43.907190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 194/383] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:43 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.118124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.118664 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.124517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.124954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.125697 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.126154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.254416 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:44.261621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fcd8c970-93f2-4ca5-8fb8-db5dc1c69dea tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.147348 Jul 25 12:42:44.262202 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 190/384] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:44.928476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:44.929077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:44.935385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.935823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.936568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:44.936997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:44.996077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.003456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-966b971e-7c1f-42da-b69c-d8f3119100be tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.078803 Jul 25 12:42:45.004022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 195/385] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:44 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:45.283369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:45.283975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:45.290176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.290620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.291382 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:45.291840 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:45.419766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:45.427204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-332a4c21-2f8b-4f2e-8261-7cf5f83eb120 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.148199 Jul 25 12:42:45.427769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 191/386] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:45 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:46.024418 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:46.025021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:46.031863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.032302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.033101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.033530 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.092404 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:46.100121 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-812aeeaa-f602-4665-bb25-521d3e41132b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.079549 Jul 25 12:42:46.100690 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 196/387] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:46 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:46.447649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:46.449779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:46.458511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.459036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.460025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:46.460464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:46.594813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:46.602940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5f06e3ae-5622-47d9-b9a1-fb47e76ba0b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.159225 Jul 25 12:42:46.603508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 192/388] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:46 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:47.121396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.122168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.128503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.128944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.129714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.130143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.189610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.197428 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-60571c48-d48b-42b7-bb9e-964d18a093e9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.079791 Jul 25 12:42:47.198012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 197/389] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:47.624413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:47.625013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:47.631639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.632077 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.632831 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:47.633260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:47.760258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:47.767476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-59d3df9e-78fe-4956-86fd-1322820a6c67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.146833 Jul 25 12:42:47.768032 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 193/390] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:47 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.218442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.219057 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:48.225879 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.226339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.227087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.227511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.288843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:48.296059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-65f05660-cdf5-4887-980b-53007a5386b1 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.081386 Jul 25 12:42:48.296613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 198/391] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:48.787904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:48.788501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:48.790369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:48.796219 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.796661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.797412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:48.797841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:48.928517 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:48.930734 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:48.937237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4775740c-4b83-46f2-bd72-b7f30a617e67 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.153465 Jul 25 12:42:48.938154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 194/392] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:48 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:49.317528 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:49.318156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:49.324514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.324952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.325698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.326166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.341602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:49.355137 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:49.387479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:49.394748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8399651e-4c5e-4c54-a3e1-9b358829bfc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.081799 Jul 25 12:42:49.395301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 199/393] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:49 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:49.959264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:49.959869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:49.965841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.966313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:49.967069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:49.967502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.095758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:50.103669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5eb76f5e-6da3-4ff2-9b04-d84a5b8c7290 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.148737 Jul 25 12:42:50.104227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 195/394] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:49 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:50.415083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:50.415628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:50.417480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:50.423104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.423550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.424304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:50.424739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:50.483653 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:50.491249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1c5100ed-b9c8-46d3-9291-24d1a9d33745 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.080022 Jul 25 12:42:50.491813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 200/395] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:50 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:51.125030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:51.125670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.131782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.132229 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.132986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.133422 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.264869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.272391 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c05b8889-2fe3-4995-9fc2-62012a3db400 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.151149 Jul 25 12:42:51.272963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 196/396] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:51 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:51.512462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:51.513045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:51.515378 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:51.521184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.521631 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.522424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:51.522852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:51.582286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:51.589539 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-04c79101-f600-4665-b0a2-3023e4b87568 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.080982 Jul 25 12:42:51.590125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 201/397] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:51 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:52.294990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:52.295617 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:52.302380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.302813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.303559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.304294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.428502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:52.435731 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b366564b-80ba-4fbd-835a-d02233255059 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.144541 Jul 25 12:42:52.436317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 197/398] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:52.610578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:52.611187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:52.617806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.618287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.619050 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:52.619484 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:52.680628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:52.687973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a5a52bb4-8392-4a78-aa01-7a417730fe98 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1263 microversion: 2.1 time: 0.081717 Jul 25 12:42:52.688541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 202/399] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:52 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.456801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.457451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.463525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.463979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.464753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.465192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.628483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.636271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cfd7dccb-91e2-429a-b253-b31d14d2596b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.184397 Jul 25 12:42:53.636849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 198/400] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:53.709622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:53.710240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:53.717484 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.718045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.718927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:53.719447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:53.782784 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:53.790728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-58ea0f28-92ba-427e-bf2e-751e6919a294 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1311 microversion: 2.1 time: 0.086691 Jul 25 12:42:53.791286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 203/401] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:53 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:54.316966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-f059c09f-b466-44d7-94c6-53e9baee2d7a req-a7f75f6b-8537-406f-8300-d8dc98ba4f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "name": "network-vif-plugged", "status": "completed", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:42:54.326495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f059c09f-b466-44d7-94c6-53e9baee2d7a req-a7f75f6b-8537-406f-8300-d8dc98ba4f88 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.326959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f059c09f-b466-44d7-94c6-53e9baee2d7a req-a7f75f6b-8537-406f-8300-d8dc98ba4f88 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.339298 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-f059c09f-b466-44d7-94c6-53e9baee2d7a req-a7f75f6b-8537-406f-8300-d8dc98ba4f88 service nova] Creating event network-vif-plugged:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:42:54.345103 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-f059c09f-b466-44d7-94c6-53e9baee2d7a req-a7f75f6b-8537-406f-8300-d8dc98ba4f88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032707 Jul 25 12:42:54.346245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 199/402] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:42:54.660003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.660603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.666425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.666866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.667663 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.668039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.813016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:54.814402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:54.817150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:54.823699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.824149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.825246 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:54.825778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:54.845303 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e0e7a223-c6a6-4018-b0f1-f0a2a8da00c5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.188386 Jul 25 12:42:54.849940 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 204/403] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:55.086392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:55.094059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-da4c66e1-424c-4e3e-97c1-dba75d8b04d6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1329 microversion: 2.1 time: 0.285463 Jul 25 12:42:55.094633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 200/404] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:54 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1329 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:42:55.870793 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:55.871394 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:55.878508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.878942 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:55.879700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:55.880128 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.027875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:56.038695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f07e49be-5ea1-4c76-9178-b428f7786f0d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.171666 Jul 25 12:42:56.039375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 205/405] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:55 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:56.116604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:56.117362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:56.124074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.124567 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.125589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.126049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.269180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:56.277168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b3c0c859-f69f-476f-b46c-442714fb5540 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.164329 Jul 25 12:42:56.277783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 201/406] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:56 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:56.659343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:56.659843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:56.666152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.666610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.667385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:56.667819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:56.794351 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lazy-loading 'services' on Instance uuid 3480c263-469e-4ba6-8104-9b8b62d02c60 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:42:56.913725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a8ad9821-af7b-47d6-ab5a-4bcc71cbed98 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60/os-volume_attachments/21872262-cfef-4c40-a881-9b3505db8dce" status: 202 len: 0 microversion: 2.1 time: 0.258748 Jul 25 12:42:56.914416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 206/407] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:42:56 2022] DELETE /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60/os-volume_attachments/21872262-cfef-4c40-a881-9b3505db8dce => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:42:57.060646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:57.061257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:57.068072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:57.068743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:57.069521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:57.069980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:57.200873 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:57.209089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-279091c0-75aa-4553-96cb-8241eda09d70 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.152268 Jul 25 12:42:57.209665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 202/408] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:57 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:57.301605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:57.305454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:57.312011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:57.312459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:57.313691 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:57.314304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:57.461970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:57.471251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4363406f-294b-455e-9d76-4423d30fe462 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.175636 Jul 25 12:42:57.471980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 207/409] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:57 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:58.230374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:58.231669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:58.233787 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:58.240564 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:58.241002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:58.241801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:58.242251 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:58.389902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:58.398790 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d2f1d1b0-e72d-4bfd-bd08-d1680bf79472 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.172427 Jul 25 12:42:58.399371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 203/410] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:58 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:58.492841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:58.494168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:58.501081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:58.501527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:58.502839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:58.503276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:58.638371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:58.646083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-61dde8a0-caf4-48b7-94a4-0527908fb41b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.157187 Jul 25 12:42:58.646658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 208/411] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:58 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:59.420431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:59.421017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:59.426969 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:59.427524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:59.428507 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:59.429080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:59.572149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:59.587896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c1f2b558-78a3-4511-a459-2f6a975cf0ad tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.171180 Jul 25 12:42:59.588485 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 204/412] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:59 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:42:59.667516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:42:59.668225 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:42:59.682455 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:59.682819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:59.683627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:42:59.684061 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:42:59.817501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:42:59.825035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-752509fb-b535-4894-9bff-4561e8aca927 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.161663 Jul 25 12:42:59.825829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 209/413] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:42:59 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:00.608853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:00.609753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:00.616377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:00.616815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:00.617568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:00.618022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:00.762658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:00.771129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9242ae23-49db-4db4-86df-d4c292db2970 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.166173 Jul 25 12:43:00.775988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 205/414] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:00 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:00.847174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:00.847785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:00.854921 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:00.855371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:00.856188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:00.856624 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:00.999541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:01.007349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ddb49512-2f4d-49ab-8652-055e20e9dab0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.164401 Jul 25 12:43:01.021929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 210/415] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:00 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:01.450858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:43:01.450976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 12:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:43:01.792439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:01.793291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:01.800124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:01.800810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:01.801750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:01.802216 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:01.938679 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:01.946698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ceef6ac2-6d7f-4da0-8f70-e5689cebc427 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.158127 Jul 25 12:43:01.947252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 206/416] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:01 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:02.028621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:02.029533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:02.037451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.038272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.039254 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.039890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.177391 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:02.185319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fba9ffec-3efc-4cfc-89c7-f0251ffb37e0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.160539 Jul 25 12:43:02.186288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 211/417] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:02 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:02.967658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:02.968258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:02.974978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.975423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:02.976189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:02.976622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.109390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.117488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c2780fb6-1ca0-41ce-8a3f-d7ded2d400f1 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.153635 Jul 25 12:43:03.118103 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 207/418] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:02 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:03.208653 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:03.209264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:03.215536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.215978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.216767 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:03.217193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:03.359599 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:03.367586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-49af7fd1-1fe3-4b98-886d-df9c063b4ebe tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.162761 Jul 25 12:43:03.368161 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 212/419] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:03 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.137541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:04.138161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:04.144235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.144680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.145439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.145870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.278711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:04.286599 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8ffadb0b-c1d5-45b9-9e4d-5d0aec07eab5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.152935 Jul 25 12:43:04.287170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 208/420] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:04 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:04.388531 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:04.389148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:04.396139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.396589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.397344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:04.397970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:04.537622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:04.545074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d29f0234-bfaa-43fb-9f61-9e55d4e97be0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.160367 Jul 25 12:43:04.545664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 213/421] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:04 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:05.309934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:05.311104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:05.320388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:05.320840 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:05.321590 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:05.322053 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:05.456244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:05.465666 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-80346912-eb3e-4d0f-9d06-205943e6dd47 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.160769 Jul 25 12:43:05.466449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 209/422] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:05 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:05.567042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:05.567656 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:05.574047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:05.574501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:05.575254 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:05.575695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:05.710427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:05.718017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f5feba71-f1fc-421e-b9e7-7e4bcb2cbbda tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.155364 Jul 25 12:43:05.718587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 214/423] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:05 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:06.487321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:06.487921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:06.494511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:06.494951 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:06.495713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:06.496138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:06.640854 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:06.649023 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-aabc85cd-ad2a-4281-a4c0-00200b425d88 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.165700 Jul 25 12:43:06.649982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 210/424] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:06 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:06.739536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:06.740071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:06.746478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:06.746914 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:06.747665 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:06.748089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:06.762940 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:06.881868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:06.889212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-762b2c12-1ee3-486f-a97a-3434f2af810a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.153639 Jul 25 12:43:06.889790 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 215/425] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:06 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:07.671180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:07.671815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:07.679324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:07.679774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:07.680547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:07.681141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:07.811760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:07.819101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b7f7e350-d8be-4797-a4b4-c0367b6c92f3 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.151800 Jul 25 12:43:07.819664 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 211/426] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:07 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:07.910586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:07.911198 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:07.917808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:07.918279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:07.919060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:07.919481 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:08.046958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:08.054174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ae44f79f-e427-4eee-96db-372295caf2b6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.148069 Jul 25 12:43:08.054730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 216/427] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:07 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:08.840210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:08.840812 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:08.846791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:08.847839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:08.848596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:08.849036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:08.852834 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:08.976145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:08.983431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a6c83ff5-4e90-490e-801e-2965aa7a1d0c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.147099 Jul 25 12:43:08.983994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 212/428] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:08 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:09.074724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:09.075344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:09.082402 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.082855 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.083614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:09.084049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:09.212277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:09.219600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3796ff7d-a692-4888-a1e0-d46c038b69ee tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.148675 Jul 25 12:43:09.220164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 217/429] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:10.004406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.004907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.010875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.011313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.012060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.012487 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.140104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:10.147788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-61165a38-3fff-4d3c-8d11-d6fb14b06a94 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.147278 Jul 25 12:43:10.148344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 213/430] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:09 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:10.240762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:10.241369 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:10.248181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.248628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.249382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:10.249818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:10.372909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:10.380719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5ad3e138-6d6b-4063-9cfe-d1ecc3a9cd56 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.144089 Jul 25 12:43:10.381291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 218/431] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:10 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.168586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.169223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.176735 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.177179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.177965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.178405 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.401384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:11.402108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:11.408873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.409323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.410671 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.411103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.423519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.431921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cfa27706-07e2-4cae-a809-b174d561d921 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.267053 Jul 25 12:43:11.432823 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 214/432] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:11.546219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:11.558380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3c0c5809-8f4b-4a45-aca3-f820893fce5a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.160645 Jul 25 12:43:11.559156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 219/433] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:11 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:11.769636 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-1a58b34e-a2af-4f74-8566-0cb1bc040dea req-365b9480-1a8b-4881-adcf-df2f92911f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:11.782088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-1a58b34e-a2af-4f74-8566-0cb1bc040dea req-365b9480-1a8b-4881-adcf-df2f92911f1b service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:11.782733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-1a58b34e-a2af-4f74-8566-0cb1bc040dea req-365b9480-1a8b-4881-adcf-df2f92911f1b service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:11.790283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:43:11.790727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:43:11.809244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-1a58b34e-a2af-4f74-8566-0cb1bc040dea req-365b9480-1a8b-4881-adcf-df2f92911f1b service nova] Creating event network-changed:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:43:11.814728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-1a58b34e-a2af-4f74-8566-0cb1bc040dea req-365b9480-1a8b-4881-adcf-df2f92911f1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051804 Jul 25 12:43:11.816943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 215/434] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:12.452763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.453301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.459717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.460154 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.460897 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.461324 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.578799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:12.579662 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:12.586894 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.587343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.588110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:12.588277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:12.588543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:12.596530 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4ab56660-3079-496d-b52a-0647354a1f2d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1369 microversion: 2.1 time: 0.147624 Jul 25 12:43:12.597701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 220/435] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:12.755765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:12.763113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-82b5731b-f183-4d04-ae18-71174d8817c8 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.188589 Jul 25 12:43:12.763684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 216/436] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:12 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:13.619140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.619743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.626315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.626762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.627516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.627953 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.758307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.765669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-43246784-ac4e-4795-846c-ba72134dfb42 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1563 microversion: 2.1 time: 0.150545 Jul 25 12:43:13.766270 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 221/437] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.783879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.784491 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.786181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.786660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:13.790679 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.791129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.791892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.792326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.792537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.792957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.793733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:13.794187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:13.870726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c343bbdd-42ec-4600-915e-f9ae7894f366 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088021 Jul 25 12:43:13.871401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 222/438] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:13.918362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:13.926667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5707a244-4fe6-471c-84a6-82d4a144474a tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.146624 Jul 25 12:43:13.927240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 217/439] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:13 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:13.995514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:13.996040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.002024 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.002469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.003848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.004290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.028115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:43:14.105615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-029016b5-9102-44ad-8466-f9adccd86efc tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 204 len: 0 microversion: 2.1 time: 0.113529 Jul 25 12:43:14.106240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 223/440] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:43:13 2022] DELETE /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:43:14.115719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:14.116331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.122942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.123525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.124379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.124889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.257549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:14.265407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-57e484b6-9798-4d26-864c-77ec16e57792 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1559 microversion: 2.1 time: 0.154544 Jul 25 12:43:14.265986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 218/441] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:14 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:14.788673 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-99738dc5-d1f2-4b24-b661-56836a706267 req-8dad20a3-5650-4ca1-a87e-7841dd2c8de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:14.798409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-99738dc5-d1f2-4b24-b661-56836a706267 req-8dad20a3-5650-4ca1-a87e-7841dd2c8de0 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.798845 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-99738dc5-d1f2-4b24-b661-56836a706267 req-8dad20a3-5650-4ca1-a87e-7841dd2c8de0 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.809380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-99738dc5-d1f2-4b24-b661-56836a706267 req-8dad20a3-5650-4ca1-a87e-7841dd2c8de0 service nova] Creating event network-changed:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:43:14.814292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-99738dc5-d1f2-4b24-b661-56836a706267 req-8dad20a3-5650-4ca1-a87e-7841dd2c8de0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030282 Jul 25 12:43:14.814880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 224/442] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:14.947099 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:14.947668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:14.953410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.953848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:14.954625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:14.955047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.085985 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:15.093286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a46b7dcf-04ce-4527-b7ce-89a5107addc0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.150082 Jul 25 12:43:15.093845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 219/443] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:14 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:15.286446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:15.287144 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:15.293258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.293699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.294495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:15.294927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:15.428191 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:15.436094 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bf0243e7-74d1-4d31-87c6-d68e684b7695 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1559 microversion: 2.1 time: 0.153863 Jul 25 12:43:15.436658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 225/444] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:15 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:16.115163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.115764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.122327 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.122765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.123519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.123978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.260113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:16.269324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1a9bae72-39e6-460b-be5d-78466dc5e2eb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.157544 Jul 25 12:43:16.270273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 220/445] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:16.458819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:16.460138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:16.467317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.467767 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.468728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:16.469608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:16.605118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:16.613601 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a0b15d81-2932-4dd2-92cf-d3c79af406bd tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1559 microversion: 2.1 time: 0.159221 Jul 25 12:43:16.614131 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 226/446] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:16 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.291192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.291806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.297745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.298248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.299007 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.299443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.433285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:17.440631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c436bcfc-1bc8-47f1-929a-ce06cfcfed71 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.153413 Jul 25 12:43:17.441200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 221/447] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:17.634791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:17.635399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:17.641789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.642268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.643026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:17.643468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:17.773341 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:17.780766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9828b437-342f-4f89-a647-cbb0477f6d7c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1513 microversion: 2.1 time: 0.149814 Jul 25 12:43:17.781319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 227/448] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:17 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.462634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.463817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.473404 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.473864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.474696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.475296 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.559922 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-5323616e-ee8c-4899-b6d9-7d4583f94569 req-6ef52942-6cd2-4264-9d07-1a1b2ddea2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "name": "network-vif-plugged", "status": "completed", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:18.570835 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-5323616e-ee8c-4899-b6d9-7d4583f94569 req-6ef52942-6cd2-4264-9d07-1a1b2ddea2aa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.571403 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-5323616e-ee8c-4899-b6d9-7d4583f94569 req-6ef52942-6cd2-4264-9d07-1a1b2ddea2aa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.583972 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-5323616e-ee8c-4899-b6d9-7d4583f94569 req-6ef52942-6cd2-4264-9d07-1a1b2ddea2aa service nova] Creating event network-vif-plugged:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:43:18.588831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-5323616e-ee8c-4899-b6d9-7d4583f94569 req-6ef52942-6cd2-4264-9d07-1a1b2ddea2aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Jul 25 12:43:18.589545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 228/449] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:18.683184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.690523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6b0bc714-66ff-49da-b21b-bfe59c83db70 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.231904 Jul 25 12:43:18.691087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 222/450] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:18.803852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:18.804832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:18.811505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.811955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.812730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:18.813166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:18.947423 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:18.954883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e30c4181-3696-483d-a981-caf9daf8affe tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1513 microversion: 2.1 time: 0.155918 Jul 25 12:43:18.955437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 229/451] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:18 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.712313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.713569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.721279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.721728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.723612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.724278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.870457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:19.878277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9a8b7ffa-95a8-4cdc-9522-a4ce7ccbb551 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.169842 Jul 25 12:43:19.886603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 223/452] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:19.954738 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-2969f7a7-ac8c-4284-8d94-b8d8cf7b56c3 req-82d8fc5b-c215-4e5e-bfbf-9729c070531f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3480c263-469e-4ba6-8104-9b8b62d02c60", "name": "network-vif-deleted", "tag": "e14dd80c-9184-42a5-9866-2e89532cfb2e"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:19.965798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-2969f7a7-ac8c-4284-8d94-b8d8cf7b56c3 req-82d8fc5b-c215-4e5e-bfbf-9729c070531f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.966275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-2969f7a7-ac8c-4284-8d94-b8d8cf7b56c3 req-82d8fc5b-c215-4e5e-bfbf-9729c070531f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.976109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:19.976706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:19.979593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-2969f7a7-ac8c-4284-8d94-b8d8cf7b56c3 req-82d8fc5b-c215-4e5e-bfbf-9729c070531f service nova] Creating event network-vif-deleted:e14dd80c-9184-42a5-9866-2e89532cfb2e for instance 3480c263-469e-4ba6-8104-9b8b62d02c60 on hv-cinder-82549 Jul 25 12:43:19.982798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.983244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.984254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:19.984679 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:19.984798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-2969f7a7-ac8c-4284-8d94-b8d8cf7b56c3 req-82d8fc5b-c215-4e5e-bfbf-9729c070531f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Jul 25 12:43:19.985276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 230/453] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:20.047127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:20.054954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1a375fa4-ca22-4d9d-becf-717377450e23 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1471 microversion: 2.1 time: 0.082756 Jul 25 12:43:20.055509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 224/454] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:19 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1471 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:20.899819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:20.900517 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:20.906700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.907146 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:20.907897 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:20.908328 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.044299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.051696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-06415d6b-449d-4798-b30c-93f64b69b668 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1359 microversion: 2.1 time: 0.155878 Jul 25 12:43:21.052255 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 231/455] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:20 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:21.076573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:21.077203 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:21.083834 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.084340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.085040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.085467 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.115619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:21.116059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:21.116516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lazy-loading 'fault' on Instance uuid 3480c263-469e-4ba6-8104-9b8b62d02c60 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:21.159530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:21.166886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5a0b3a45-eb6d-4f3e-b15a-afbdae27dbde tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 200 len: 1308 microversion: 2.1 time: 0.094150 Jul 25 12:43:21.167444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 225/456] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:21 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:22.073098 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.073803 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.076134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:22.081576 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.082049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.082820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.083251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.188458 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.189285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: 3480c263-469e-4ba6-8104-9b8b62d02c60] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.195918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.196365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.197314 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.197746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.211349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] HTTP exception thrown: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Request method failure captured: Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 HTTP/1.1 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8_ME3sJqktfM-BkIaoPb4ADXeDTf8gtjjlxoBeQlJg0KE62563HF31z57bEPc_NxDd8mJnWTmLiB_kGKduw7-TMC6uy6zd2E5Ne7YWeBxRI337HsaicOD-KFYCrNmV0cSA_shszrTGiagajs0yKfRoglo9SCcV6-EIufvDqWoGc9g Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 5d2fa8874dab4d3bbc87161b540ffae9 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:43:22.213014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 5d2fa8874dab4d3bbc87161b540ffae9 Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-VolumesSnapshotTestJSON-507215875-project Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 0f4376954dbd4402ae5a990f1a56baf3 Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-VolumesSnapshotTestJSON-507215875-project Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. Jul 25 12:43:22.214687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '3480c263-469e-4ba6-8104-9b8b62d02c60'} Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:43:22.215600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. Jul 25 12:43:22.217016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:43:22.218334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Returning 404 to user: Instance 3480c263-469e-4ba6-8104-9b8b62d02c60 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:43:22.218334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d0b282d0-4530-4361-af67-08fba551bebb tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60" status: 404 len: 111 microversion: 2.1 time: 0.031136 Jul 25 12:43:22.218508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.218888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 226/457] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/3480c263-469e-4ba6-8104-9b8b62d02c60 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:43:22.220808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:22.226205 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b77d6c81-1f90-4343-8e29-03a50cfd7c9b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1549 microversion: 2.1 time: 0.157050 Jul 25 12:43:22.226762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 232/458] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:22.248906 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.249509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.256409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.256875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.257629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.258091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.389819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.398171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8bc9f92b-ffae-4fae-aecf-c24fe5ce7850 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1549 microversion: 2.1 time: 0.153961 Jul 25 12:43:22.398750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 227/459] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:22.419634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.424867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.426305 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Searching by: {'deleted': False, 'project_id': '8260111bf70a4afab166caf5a4881931'} {{(pid=129815) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 12:43:22.435329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.435814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.436598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.437071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.529201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.multi_cell_list [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129815) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 12:43:22.622516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-02ee9ec4-9118-4dfa-b5f3-8344822687f4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207464 Jul 25 12:43:22.623101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 233/460] 10.222.0.60 () {58 vars in 1125 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:22.634284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:22.634891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:22.640795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.641241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.642021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:22.642461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:22.772192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:22.779541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e3e31c91-18bb-44e4-a5ee-d822e38769e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1549 microversion: 2.1 time: 0.149037 Jul 25 12:43:22.780101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 228/461] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:22 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:28.511757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c4113fc-827e-40cc-a68a-e664be515bfc"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:28.514056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:28.520535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.520981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.521741 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:28.522201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:28.795791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f8a71adf-df84-485b-90b9-321ed184dadb tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287777 Jul 25 12:43:28.796494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 234/462] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:43:28 2022] POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:34.217221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-705568634", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "networks": [{"uuid": "f1d4b61f-f554-4201-9844-f84836207901"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:34.226128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=53 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:34.226942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=95 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:34.271013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] validate_networks() for [('f1d4b61f-f554-4201-9844-f84836207901', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:43:34.617902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:43:34.618403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:43:34.618893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:43:34.619288 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:43:34.619687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:43:34.628310 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.628744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.630147 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:34.630574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:34.648460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Getting quotas for project 5d2fa8874dab4d3bbc87161b540ffae9. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:43:34.652288 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Getting quotas for user 0f4376954dbd4402ae5a990f1a56baf3 and project 5d2fa8874dab4d3bbc87161b540ffae9. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:43:34.663029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:43:34.665209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:43:34.709899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e6672f99-360e-413c-b6ef-ec876f34ce43 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496402 Jul 25 12:43:34.710570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 229/463] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:43:34.719708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:34.724267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3e25057e-a75b-488b-b95b-d99707936303 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:34.729881 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3e25057e-a75b-488b-b95b-d99707936303 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:34.783936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3e25057e-a75b-488b-b95b-d99707936303 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:34.790522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3e25057e-a75b-488b-b95b-d99707936303 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1218 microversion: 2.1 time: 0.072862 Jul 25 12:43:34.802085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 235/464] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:34 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:35.707613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.708195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.714148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.714586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.715341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.715765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.739649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c13f568a-b63f-4eef-bd2f-fed423053e4a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/ips" status: 200 len: 151 microversion: 2.20 time: 0.036465 Jul 25 12:43:35.740210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 230/465] 10.222.0.60 () {60 vars in 1289 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:43:35.812227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:35.812822 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:35.819566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.820252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.821193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:35.821776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:35.898603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:35.908813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-940eac02-4bef-482f-a7eb-b71957285a97 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1278 microversion: 2.1 time: 0.100192 Jul 25 12:43:35.920851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 236/466] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:35 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:36.930579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:36.931188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:36.937302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.937781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:36.938665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:36.939183 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.156209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:37.164713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a2790082-9932-42b0-b3d7-c7101715daf9 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.238712 Jul 25 12:43:37.165521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 231/467] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:36 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:37.299685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-c0ad9bcb-2eb1-4449-ad70-acd39c3ac380 req-f8b04928-6ad7-4fa3-87c8-2bb606e19216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8402cd-17d9-450f-9f3c-72646416255e", "tag": "c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:37.313331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-c0ad9bcb-2eb1-4449-ad70-acd39c3ac380 req-f8b04928-6ad7-4fa3-87c8-2bb606e19216 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.314051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-c0ad9bcb-2eb1-4449-ad70-acd39c3ac380 req-f8b04928-6ad7-4fa3-87c8-2bb606e19216 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.332952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-c0ad9bcb-2eb1-4449-ad70-acd39c3ac380 req-f8b04928-6ad7-4fa3-87c8-2bb606e19216 service nova] Creating event network-changed:c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee for instance fa8402cd-17d9-450f-9f3c-72646416255e on hv-cinder-82549 Jul 25 12:43:37.335836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-c0ad9bcb-2eb1-4449-ad70-acd39c3ac380 req-f8b04928-6ad7-4fa3-87c8-2bb606e19216 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040010 Jul 25 12:43:37.336432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 237/468] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:37.824787 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:37.825316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:37.831293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.831741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.832498 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:37.832927 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:37.855411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lazy-loading 'flavor' on Instance uuid 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:43:38.098713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a2d9248d-0039-445a-9cce-bb07d24c4254 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/action" status: 202 len: 0 microversion: 2.20 time: 0.277088 Jul 25 12:43:38.099369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 232/469] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Jul 25 12:43:37 2022] POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:43:38.108009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.109742 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.117072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.117601 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.118469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.118978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.188123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:38.189304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:38.198751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.199194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.199960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:38.200386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:38.251924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.260047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.261618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.262955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d8c90cc7-ee9e-4aec-b5b5-33f1096d5f4f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.159201 Jul 25 12:43:38.263595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 238/470] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:38.335675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:38.343434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-879f106a-780a-4b84-98e8-e73807a152ef tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.160456 Jul 25 12:43:38.347093 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 233/471] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:38 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:39.286252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:39.286861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.293409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.293853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.294636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.295069 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.365320 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:39.365934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:39.371759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.372196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.372953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:39.373382 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:39.428138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.436082 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.437855 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.439408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5b8aca4c-6902-4d5f-948d-d0b6880cb6d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.157004 Jul 25 12:43:39.440084 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 239/472] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:39 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:39.514381 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:39.522273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-725e0544-cd74-4c79-a03d-0f01eadb64a5 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.161217 Jul 25 12:43:39.522833 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 234/473] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:39 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:40.462250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.462780 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.469239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.469702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.470608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.471036 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.543595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:40.544207 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:40.550278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.550725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.552150 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:40.552582 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:40.606944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.616815 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.618332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.619792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1472fa75-960d-4365-97f8-42f9af62c8f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.161542 Jul 25 12:43:40.620642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 240/474] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:40.689096 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:40.696423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fd4f59d3-1445-48eb-9f51-408198670077 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.156661 Jul 25 12:43:40.696989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 235/475] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:40 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:41.642214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.642911 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.649295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.649733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.650517 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.650945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.718293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:41.718918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:41.725110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.725554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.726375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:41.727097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:41.778546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.786396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.787824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.788971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-70aee2e8-f023-481f-ae8a-04db745ba34d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.150538 Jul 25 12:43:41.789520 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 241/476] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:41.857180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:41.865260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ff4220e5-d328-4389-a698-2ea98f2a0c57 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.150789 Jul 25 12:43:41.865846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 236/477] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:41 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:42.812619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.813221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.820080 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.820520 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.821265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.821694 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.886192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:42.886799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:42.892612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.893047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.893795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:42.894242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:42.952385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.960391 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.961885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:42.963066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e1145b24-b073-43d0-a73b-090b26c86371 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.154383 Jul 25 12:43:42.974942 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 242/478] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:42 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:43.023439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:43.030853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e9c877e3-d839-475f-b93e-b65eacf8523b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.148603 Jul 25 12:43:43.031426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 237/479] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:42 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:43.986177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:43.986783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:43.993708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:43.994216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:43.994957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:43.995392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.051689 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:44.052872 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:44.058785 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.059222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.059963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.060383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.125759 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.133658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.135195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.136335 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-97975ae8-f0a2-42d7-b0f6-ff4676dee28a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.154439 Jul 25 12:43:44.137079 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 243/480] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:43 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:44.188223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:44.195308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b86c6478-fb15-42d6-96bf-b60c9f396376 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.147464 Jul 25 12:43:44.195863 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 238/481] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:44 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:44.881062 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:44.881658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:44.883640 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:44.889407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.889857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:44.890648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:44.891081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.024594 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.033976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-368869cb-bb49-41c3-89a9-0f14354a7889 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1595 microversion: 2.1 time: 0.157307 Jul 25 12:43:45.034786 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 244/482] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:44 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:45.124161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-dfda6565-560d-4f22-93ec-09fd3b161b86 req-c10b4805-7f20-4b26-9bfe-4bb2c63becf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8402cd-17d9-450f-9f3c-72646416255e", "name": "network-vif-plugged", "status": "completed", "tag": "c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:45.133004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:45.134363 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:45.142853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-dfda6565-560d-4f22-93ec-09fd3b161b86 req-c10b4805-7f20-4b26-9bfe-4bb2c63becf1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.143795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-dfda6565-560d-4f22-93ec-09fd3b161b86 req-c10b4805-7f20-4b26-9bfe-4bb2c63becf1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.161307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-dfda6565-560d-4f22-93ec-09fd3b161b86 req-c10b4805-7f20-4b26-9bfe-4bb2c63becf1 service nova] Creating event network-vif-plugged:c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee for instance fa8402cd-17d9-450f-9f3c-72646416255e on hv-cinder-82549 Jul 25 12:43:45.162529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:45.163574 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:45.167849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-dfda6565-560d-4f22-93ec-09fd3b161b86 req-c10b4805-7f20-4b26-9bfe-4bb2c63becf1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048574 Jul 25 12:43:45.169056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 239/483] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:45.175506 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.176171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.177457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.178468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.216680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:45.217373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:45.233670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.234964 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.235789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:45.236229 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:45.356824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.369334 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.370965 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.372330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9f442014-9cf9-420e-af18-4f9e879c6018 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.217771 Jul 25 12:43:45.373177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 245/484] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:45 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:45.396239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:45.403719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-286aba76-5327-47df-975a-4e72642ba6e1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.191134 Jul 25 12:43:45.404293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 240/485] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:45 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:43:46.396981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.397591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:46.404366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.404894 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.405811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.406277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.425201 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:46.426480 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:46.432738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.433385 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.434168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:46.434598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:46.566632 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.574593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2bb16caf-2d3f-4d2f-a5e0-e70e1220072b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.153279 Jul 25 12:43:46.575161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 241/486] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:46.649817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.657667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.659198 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:46.660347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a1136828-1e13-45a1-bd46-151c7c3d6976 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.267891 Jul 25 12:43:46.660904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 246/487] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:46 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:47.021196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-8fd11e0b-e685-4604-a6f2-b2023f351469 req-a550e379-2ed3-4e3b-bac5-3ec07c1adbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:47.030344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8fd11e0b-e685-4604-a6f2-b2023f351469 req-a550e379-2ed3-4e3b-bac5-3ec07c1adbb5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.031087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8fd11e0b-e685-4604-a6f2-b2023f351469 req-a550e379-2ed3-4e3b-bac5-3ec07c1adbb5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.043700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-8fd11e0b-e685-4604-a6f2-b2023f351469 req-a550e379-2ed3-4e3b-bac5-3ec07c1adbb5 service nova] Creating event network-changed:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:43:47.049042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-8fd11e0b-e685-4604-a6f2-b2023f351469 req-a550e379-2ed3-4e3b-bac5-3ec07c1adbb5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031489 Jul 25 12:43:47.049718 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 242/488] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:47.595589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.596809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.604166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.604924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.605898 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.606537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.684267 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:47.684869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:47.695608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.696284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.699193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:47.699860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:47.861371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.874040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-57eb30a8-4b65-4f87-bbc8-9152faf0e79d tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1318 microversion: 2.1 time: 0.282097 Jul 25 12:43:47.888105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 247/489] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:47 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:47.888581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.897140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.898765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:47.900012 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-aa2a1e3c-e16c-4430-ac07-5ee725fa6cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.220130 Jul 25 12:43:47.900566 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 243/490] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:47 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:48.168389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-300315685"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:48.168928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.174991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.175437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.176227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.176662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.308184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.network.security_group_api [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Adding security group b667ca07-8f57-4c71-acf8-a651c23796fd to port 70c70048-0571-4440-8eed-920a0694232f Jul 25 12:43:48.666195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e8eed7b4-3e88-4d81-bae0-347e9ba1847f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action" status: 202 len: 0 microversion: 2.1 time: 0.502231 Jul 25 12:43:48.667287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 248/491] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:43:48 2022] POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:43:48.674726 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:48.675334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.683871 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.684234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.685189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.686206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.844901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:48.854136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-dcbc27ed-d89a-45f6-8b7d-b2991de974dd tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1760 microversion: 2.1 time: 0.183118 Jul 25 12:43:48.854871 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 244/492] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:48 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:48.895605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:48.896208 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.902194 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.902632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.903415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.903864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.924700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:48.925615 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:48.933128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.933675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:48.935236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:48.935749 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.047724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:49.050632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:49.062672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-291d13a9-af55-410e-b725-4b06981ee6c1 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1508 microversion: 2.1 time: 0.170962 Jul 25 12:43:49.077030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 249/493] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:43:48 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:43:49.077030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-fb1d0815-f8c5-487b-a830-cf6a268303e6 req-233b2403-7c30-4e85-8f9f-db42e4bb9045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:49.080620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:49.080981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-fb1d0815-f8c5-487b-a830-cf6a268303e6 req-233b2403-7c30-4e85-8f9f-db42e4bb9045 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:49.081432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-fb1d0815-f8c5-487b-a830-cf6a268303e6 req-233b2403-7c30-4e85-8f9f-db42e4bb9045 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.084899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:49.092384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:49.093878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:49.095210 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-fb1d0815-f8c5-487b-a830-cf6a268303e6 req-233b2403-7c30-4e85-8f9f-db42e4bb9045 service nova] Creating event network-changed:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:43:49.095348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e8a07a73-7d56-42cc-9701-9e46c28db876 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.175053 Jul 25 12:43:49.095818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 245/494] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:48 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:49.101175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5473a457-e8da-43b5-be06-901e3942ddfb", "device": "/dev/sdb"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:49.104149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:49.111453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:49.112095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-fb1d0815-f8c5-487b-a830-cf6a268303e6 req-233b2403-7c30-4e85-8f9f-db42e4bb9045 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047140 Jul 25 12:43:49.112209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.112716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 250/495] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:49.113428 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:49.114116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:49.422066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-14f5b65f-ef8b-46d7-b9e5-f173854a510b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "POST /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324713 Jul 25 12:43:49.422703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 246/496] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:43:49 2022] POST /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:50.122375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:50.123159 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:50.130369 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:50.130820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:50.131945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:50.132389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:50.297611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:50.307994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:50.309537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:50.310688 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-62840bc1-10c4-4ebd-ba22-6622f9244e44 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.193856 Jul 25 12:43:50.311257 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 251/497] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:50 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:51.340425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:51.341116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:51.347868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.348315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.349732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:51.350199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:51.480824 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.489083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.490647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:51.491798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-09e5b07c-de04-4450-885e-6116632a2bcb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.156179 Jul 25 12:43:51.492365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 247/498] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:51 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:52.514623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:52.515237 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:52.517651 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=42 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:52.523043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:52.523491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.524284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:52.524717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:52.655330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:52.664479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:52.666023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:52.667179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3eb8433c-0348-4cea-86a6-28fcf667e7d3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.156540 Jul 25 12:43:52.667731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 252/499] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:52 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:53.690535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:53.691141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:53.697514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:53.697987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:53.698747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:53.699177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:53.838210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:53.845970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:53.847461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:53.848602 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6e0256db-1c3a-4c1d-b66c-95147aae9665 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.161889 Jul 25 12:43:53.849154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 248/500] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:53 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:54.499482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:54.499969 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.507096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.507534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.508307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.508754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.530925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7ae16d01-a80c-40c2-b3f2-83cad8ed6cde tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/ips" status: 200 len: 151 microversion: 2.1 time: 0.035283 Jul 25 12:43:54.531478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 253/501] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:43:54 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:43:54.873271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:54.874539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:54.883342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.883888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:54.884511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:54.884935 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:55.014016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:55.022494 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:55.024000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:55.025149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-17a15d5b-71b4-4126-8cd8-16e988e49346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.156311 Jul 25 12:43:55.025727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 249/502] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:54 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:55.904974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e36faab5-b15d-4563-b0ee-1586bf6caa6e"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:43:55.907377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:55.914799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:55.915235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:55.916121 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:55.916545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.049885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:56.050519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:56.057066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.057555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.058333 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:56.058764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:56.198082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:56.205985 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:56.207469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:56.208736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-68be5889-a41b-4281-a86a-3bca915d3acc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.162554 Jul 25 12:43:56.209763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 250/503] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:56 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:43:56.782643 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-180f8fd4-0fae-4985-9885-46490326ef6b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881324 Jul 25 12:43:56.783249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 254/504] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:43:55 2022] POST /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:43:57.231759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:57.232374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:57.239009 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.239399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.240158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:57.240592 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:57.411674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.420109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.421599 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:57.422768 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ffafb155-6643-490c-9a21-29f6cb9bef97 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.194862 Jul 25 12:43:57.423328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 251/505] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:57 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:58.451151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:58.452062 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:58.461097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.461721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.462849 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:58.463460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:58.643783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:58.651842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:58.653343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:58.654541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-83b3cf96-39c3-4780-8324-d3b61fad3afb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.211042 Jul 25 12:43:58.655141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 255/506] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:58 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:43:59.678021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:43:59.678597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:43:59.685281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.685727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.686527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:43:59.686960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:43:59.820278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.828292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.829782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:43:59.830989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8d20a1be-3621-4002-873a-12266d694f6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.156990 Jul 25 12:43:59.831540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 252/507] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:43:59 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:00.855090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:00.855698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:00.862445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.862895 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.863657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:00.864090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:00.997380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:01.005657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:01.007178 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:01.008329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d100c123-2e9b-4d10-b337-f0c75500ef30 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.157182 Jul 25 12:44:01.008885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 256/508] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:00 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:02.031326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:02.031923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:02.039154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.039602 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.040349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:02.040806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:02.171559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:02.180277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:02.181806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:02.182977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8d6d894c-16c1-49fb-8712-ca93b82b8e85 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.155466 Jul 25 12:44:02.183522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 253/509] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:02 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:03.204890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:03.205638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:03.213437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.214271 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.215038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:03.215466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:03.348827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:03.356731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:03.358231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:03.359750 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6cffbfcf-6ac6-4f9f-99d8-4cc4b14c2a3e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.158981 Jul 25 12:44:03.360433 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 257/510] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:03 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:04.383870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:04.384489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:04.387979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:04.391389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.391813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.392571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:04.393000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:04.527159 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:04.534995 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:04.537008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:04.538176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3dfc6143-8990-487e-9091-0d7d5b4a0a07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.158250 Jul 25 12:44:04.538731 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 254/511] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:04 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:05.562170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:05.562769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:05.569271 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:05.569710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:05.570499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:05.570927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:05.703007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:05.711526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:05.713021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:05.714202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-277d74e6-db0a-4ad7-b21d-6533480d5d9d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.155897 Jul 25 12:44:05.714768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 258/512] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:05 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:06.738215 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:06.738795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:06.745893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.746372 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.747125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:06.747548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:06.879156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:06.887080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:06.888561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:06.889697 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cec25083-fd31-4dcb-aa5e-e057a3a8df07 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.155703 Jul 25 12:44:06.890283 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 255/513] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:06 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:07.912584 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:07.913125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:07.920196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.920665 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:07.921420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:07.921848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:08.054323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:08.062278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:08.063766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:08.064909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-aa6f9880-a388-43af-9175-2c02858b9ca8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.156399 Jul 25 12:44:08.065457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 259/514] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:07 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:09.088270 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:09.088903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:09.095438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.095877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.096642 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:09.097070 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:09.226182 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:09.234447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:09.235954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:09.237110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6e202fb8-e687-4126-98f4-79bcd1828eeb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.153344 Jul 25 12:44:09.237670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 256/515] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:09 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:10.260570 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:10.261202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:10.267757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.268211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.268970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:10.269403 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:10.404717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:10.412602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:10.414146 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:10.415296 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-eafa1ef0-25a1-4c47-84e0-5a7246e6cab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.158658 Jul 25 12:44:10.415850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 260/516] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:10 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:11.438510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:11.439060 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:11.445586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.446066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.446819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:11.447245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:11.585681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.593535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.595426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:11.596181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-40877bfd-ff56-484e-be79-95bd4d182f1c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.161618 Jul 25 12:44:11.596733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 257/517] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:11 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:12.619730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:12.620327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:12.626765 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.627204 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.627960 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:12.628380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:12.789942 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.799051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.800968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:12.802853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-71e05e3a-6177-4d0c-a02e-dd4dfb164393 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.187010 Jul 25 12:44:12.816398 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 261/518] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:12 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:13.063745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-4bc7d364-a5d1-4ed0-92c9-3583bd3af17e req-8b8f7fc9-533b-416a-b513-ce1165f851de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:13.074923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-4bc7d364-a5d1-4ed0-92c9-3583bd3af17e req-8b8f7fc9-533b-416a-b513-ce1165f851de service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.075363 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-4bc7d364-a5d1-4ed0-92c9-3583bd3af17e req-8b8f7fc9-533b-416a-b513-ce1165f851de service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.086861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-4bc7d364-a5d1-4ed0-92c9-3583bd3af17e req-8b8f7fc9-533b-416a-b513-ce1165f851de service nova] Creating event network-vif-plugged:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:44:13.091885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-4bc7d364-a5d1-4ed0-92c9-3583bd3af17e req-8b8f7fc9-533b-416a-b513-ce1165f851de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Jul 25 12:44:13.092654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 258/519] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:13.826667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:13.827867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:13.835591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.836040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.836812 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:13.837249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:13.838875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d1842409-0657-4f64-8fd4-251c50b84fb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: .version_select at 0x7f4c2d62d8b0>, body: {"keypair": {"name": "tempest-keypair-2023824732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs3Qu0GqnycVs9GZT2qyrC/xgm/sVzyN/EMWz7AiclyBY4NO1flkiHkkbSSgK5H2lsb9Eyvjecmm4jU60fpzeZIADw+wZ4hSE2NSjapgynvSTLCo5AAQvvGGGPl7yAytQ=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:13.854942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-d1842409-0657-4f64-8fd4-251c50b84fb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:13.859048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-d1842409-0657-4f64-8fd4-251c50b84fb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:13.886223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d1842409-0657-4f64-8fd4-251c50b84fb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051292 Jul 25 12:44:13.887063 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 259/520] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:44:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:44:13.990968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:13.998904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.000410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:14.001561 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b612ed23-07fc-4a55-9b19-d92ce1c42a5b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.179474 Jul 25 12:44:14.002154 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 262/521] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:13 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:15.025895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:15.027508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:15.034067 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.034704 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.035639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.036375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.217666 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.225792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.227308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:15.228461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-dac970c2-ff5c-4262-9eed-38b436018dc7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.207803 Jul 25 12:44:15.229016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 260/522] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:15 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:15.267462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-309033368", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4181ae2d-cd73-4cb4-a9d0-f28fef05143a"}], "security_groups": [{"name": "tempest-securitygroup--994668742"}], "key_name": "tempest-keypair-2023824732", "user_data": "}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:15.370539 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] validate_networks() for [('4181ae2d-cd73-4cb4-a9d0-f28fef05143a', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:44:15.976479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:44:15.976895 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:44:15.977361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:44:15.977758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:44:15.978184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:44:15.987280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.987716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:15.988501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:15.988922 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.005249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:44:16.009157 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:44:16.019997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:44:16.022774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:44:16.072596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a67713be-b360-4907-9113-d220416ffc15 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.809260 Jul 25 12:44:16.073382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 263/523] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:44:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:44:16.075185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:16.075687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:16.084136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.084582 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.084692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4520b4e2-154f-450a-8b05-c444606c5cc7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:16.085249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4520b4e2-154f-450a-8b05-c444606c5cc7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:16.086021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.086457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.143697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4520b4e2-154f-450a-8b05-c444606c5cc7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:16.150580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4520b4e2-154f-450a-8b05-c444606c5cc7 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1241 microversion: 2.1 time: 0.070215 Jul 25 12:44:16.160669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 264/524] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:16 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:16.224986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lazy-loading 'services' on Instance uuid fa8402cd-17d9-450f-9f3c-72646416255e {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:16.261654 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:16.262364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:16.269065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.269690 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.270284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:16.270713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:16.367672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-074e5394-5cd3-475c-915c-2a010a5f7ad6 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e/os-volume_attachments/5473a457-e8da-43b5-be06-901e3942ddfb" status: 202 len: 0 microversion: 2.1 time: 0.296076 Jul 25 12:44:16.368753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 261/525] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:44:16 2022] DELETE /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e/os-volume_attachments/5473a457-e8da-43b5-be06-901e3942ddfb => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:44:16.422325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:16.431329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:16.434268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:16.436134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-068b3767-6886-4248-a140-97acefd0dbca tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1744 microversion: 2.20 time: 0.184829 Jul 25 12:44:16.436887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 265/526] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:16 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:17.174415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:17.175185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:17.184991 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.185497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.188593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.189079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.194491 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:17.264609 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.275277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-733f8b5c-5a39-4a38-bb14-a13c2c150b51 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1237 microversion: 2.1 time: 0.106368 Jul 25 12:44:17.286623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 262/527] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:17 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:17.460965 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:17.461566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:17.468319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.468764 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.469564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:17.470014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:17.622551 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.633181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.635001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:17.636447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-18a14e1e-5748-474d-8976-02023c62d56f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.179670 Jul 25 12:44:17.637327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 266/528] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:17 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:18.297732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.298800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.305073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.305519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.306315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.311521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.396044 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:18.404141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2c8af9f1-6bc3-4185-9039-845c0d1e1e46 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1299 microversion: 2.1 time: 0.110192 Jul 25 12:44:18.406319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 263/529] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:18 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:18.585452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.586162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.592618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.593147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.594021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.594528 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.623103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:44:18.626412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:18.661993 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.662522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.670717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.674519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.678362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.678362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.755885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-861837a2-d5ca-4459-b6dc-d21d397b21c2 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 204 len: 0 microversion: 2.1 time: 0.174129 Jul 25 12:44:18.761743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 267/530] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:44:18 2022] DELETE /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:18.768101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:18.769065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:18.776379 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.776829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.778034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:18.778477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:18.895991 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:18.908771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:18.910691 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:18.913181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-38318b2e-d459-4e3a-9e39-1da5038062d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.255388 Jul 25 12:44:18.934781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 264/531] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:18 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:19.002442 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.026920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-724dffd6-92d3-4df5-a614-ca1dd601fb3c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1514 microversion: 2.1 time: 0.262990 Jul 25 12:44:19.027893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 268/532] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:18 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:19.426912 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:19.427471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:19.433647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.434137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.434914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.435353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.573861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:19.583637 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8f595396-7379-443a-ae52-5202c7216905 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.160080 Jul 25 12:44:19.584758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 265/533] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:19 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:19.946755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:19.947571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:19.956604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.957194 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:19.958041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:19.958801 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.050864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.052727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.067695 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.068138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.069078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.069696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.125844 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.137302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.139388 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.141467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4bd2ece8-1d03-4067-9e7b-dc199f5482d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.203170 Jul 25 12:44:20.142316 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 269/534] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:19 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:20.261814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.271690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bb5bb9b8-87b7-4881-9f8f-52096f172f9a tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1514 microversion: 2.1 time: 0.225391 Jul 25 12:44:20.272802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 266/535] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:20.609095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:20.609709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:20.617373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.618006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.618783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:20.619214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:20.768676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:20.778439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5659693b-3d40-496f-9f4e-a1398ac493d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.174818 Jul 25 12:44:20.779286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 270/536] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:20 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:21.107087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-f4b7ccf4-d79b-4123-aca0-b185c2f51531 req-3597d62f-36dd-46e1-8e6a-9a4d825212ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a118fe-83de-487b-baf3-8942c875079e", "tag": "f58b1b0c-4007-4e0a-bbb3-0de1556a42fd"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:21.128242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f4b7ccf4-d79b-4123-aca0-b185c2f51531 req-3597d62f-36dd-46e1-8e6a-9a4d825212ad service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.128785 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f4b7ccf4-d79b-4123-aca0-b185c2f51531 req-3597d62f-36dd-46e1-8e6a-9a4d825212ad service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.149897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-f4b7ccf4-d79b-4123-aca0-b185c2f51531 req-3597d62f-36dd-46e1-8e6a-9a4d825212ad service nova] Creating event network-changed:f58b1b0c-4007-4e0a-bbb3-0de1556a42fd for instance 70a118fe-83de-487b-baf3-8942c875079e on hv-cinder-82549 Jul 25 12:44:21.155049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-f4b7ccf4-d79b-4123-aca0-b185c2f51531 req-3597d62f-36dd-46e1-8e6a-9a4d825212ad service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052039 Jul 25 12:44:21.155756 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 267/537] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:21.165274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.165934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.175156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.175828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.177868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.178554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.298369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.299794 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.320651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.325476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.326745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.327355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.404768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.413722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.415310 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.416591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d87a0f11-d22c-4c09-9740-8e57c58587ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.255851 Jul 25 12:44:21.417149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 271/538] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:21.800318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:21.801246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:21.824946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.825410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.827579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:21.828212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:21.965337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:21.978028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c202c383-8634-4903-a4d9-71bc886e0e2b tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1514 microversion: 2.1 time: 0.684732 Jul 25 12:44:21.982177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 268/539] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1514 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.058792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.073017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-84d29cf5-c0a6-4265-bcff-bfc27c0254ad tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.276597 Jul 25 12:44:22.074217 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 272/540] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:21 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:22.439624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:22.443398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:22.478227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.478687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.479490 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:22.479924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:22.822078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.836089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.838076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:22.839535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4627407d-16c7-40d4-9d3a-b5fef32accfc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.404279 Jul 25 12:44:22.850362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 269/541] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:22 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:23.083962 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.086575 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.090605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:23.101497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.104997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.121003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.124361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.125119 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.125764 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.127134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.127836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.130079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.130811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.232905 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.234095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.235445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lazy-loading 'fault' on Instance uuid fa8402cd-17d9-450f-9f3c-72646416255e {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:44:23.319197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4376954dbd4402ae5a990f1a56baf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d2fa8874dab4d3bbc87161b540ffae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.342034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2504d0a4-10fa-4e30-acb5-77cb42c3a5d8 tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 200 len: 1308 microversion: 2.1 time: 0.262692 Jul 25 12:44:23.346053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 273/542] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:23.353397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-a1f4ac52-1819-4217-a489-15eee1b9385f req-7db789bc-7dc5-4af6-8385-0a799cf5dec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8402cd-17d9-450f-9f3c-72646416255e", "name": "network-vif-deleted", "tag": "c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:23.366433 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a1f4ac52-1819-4217-a489-15eee1b9385f req-7db789bc-7dc5-4af6-8385-0a799cf5dec3 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.367267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a1f4ac52-1819-4217-a489-15eee1b9385f req-7db789bc-7dc5-4af6-8385-0a799cf5dec3 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.385380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-a1f4ac52-1819-4217-a489-15eee1b9385f req-7db789bc-7dc5-4af6-8385-0a799cf5dec3 service nova] Creating event network-vif-deleted:c0f6ea57-78e8-4a76-9e7f-a6bf1ad82eee for instance fa8402cd-17d9-450f-9f3c-72646416255e on hv-cinder-82549 Jul 25 12:44:23.392713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-a1f4ac52-1819-4217-a489-15eee1b9385f req-7db789bc-7dc5-4af6-8385-0a799cf5dec3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044900 Jul 25 12:44:23.394032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 274/543] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:23.434907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:23.443275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cb32a86d-b1d4-403d-8cc8-dad20c41235b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.349273 Jul 25 12:44:23.443894 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 270/544] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:23.864811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:23.865885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:23.873173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.873716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:23.874612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:23.875249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.066578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.075786 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.077412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.078737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ed489d00-28f1-4c73-8348-c44d3bdf6c20 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.218265 Jul 25 12:44:24.079379 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 275/545] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:23 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:24.364472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.365280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] [instance: fa8402cd-17d9-450f-9f3c-72646416255e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:24.371072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:24.376025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.376460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.377243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.377639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.394057 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] HTTP exception thrown: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Request method failure captured: Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e HTTP/1.1 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8_ME3sJqktfM-BkIaoPb4ADXeDTf8gtjjlxoBeQlJg0KE62563HF31z57bEPc_NxDd8mJnWTmLiB_kGKduw7-TMC6uy6zd2E5Ne7YWeBxRI337HsaicOD-KFYCrNmV0cSA_shszrTGiagajs0yKfRoglo9SCcV6-EIufvDqWoGc9g Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 5d2fa8874dab4d3bbc87161b540ffae9 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:44:24.395702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5d2fa8874dab4d3bbc87161b540ffae9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 5d2fa8874dab4d3bbc87161b540ffae9 Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-507215875 Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-VolumesSnapshotTestJSON-507215875-project Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 0f4376954dbd4402ae5a990f1a56baf3 Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-VolumesSnapshotTestJSON-507215875-project Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. Jul 25 12:44:24.397137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'fa8402cd-17d9-450f-9f3c-72646416255e'} Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:44:24.397879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. Jul 25 12:44:24.399165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:44:24.400278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] Returning 404 to user: Instance fa8402cd-17d9-450f-9f3c-72646416255e could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:44:24.400278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-40b51b8c-8b94-4769-9516-bc21c499a91c tempest-VolumesSnapshotTestJSON-507215875 tempest-VolumesSnapshotTestJSON-507215875-project] 10.222.0.60 "GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e" status: 404 len: 111 microversion: 2.1 time: 0.036999 Jul 25 12:44:24.400278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 271/546] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/servers/fa8402cd-17d9-450f-9f3c-72646416255e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:44:24.468638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:24.470042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:24.482276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.482863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.485829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:24.486363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:24.657546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:24.682915 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2bbebcf9-a06e-4081-b80a-a9c808e96c5f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.217206 Jul 25 12:44:24.698244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 276/547] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:24 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:25.102947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.104544 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.112752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.114010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.115467 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.116175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.273308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.281417 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.283735 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.285158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3252c40a-ed69-4647-8c62-21e24724fbc4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.186653 Jul 25 12:44:25.302123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 272/548] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:25.708529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:25.709177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:25.716777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.717220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.718019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:25.718560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:25.902452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:25.912034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9cd38077-c2e4-4a6c-82f8-d4b561bf0dfd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.210103 Jul 25 12:44:25.913189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 277/549] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:25 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:26.312398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.313042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.321494 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.321960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.322926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.323359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.474206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.482413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.484156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:26.485320 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e6ec323c-507a-4f91-808c-e0bf8d0f8926 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.179403 Jul 25 12:44:26.485922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 273/550] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:26.937209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:26.937776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:26.939701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:26.940487 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=8 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:26.947059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.947505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:26.948279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:26.948724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.093053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.101675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2731cffa-d399-4fe2-bcdd-5dcb098a2826 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.168377 Jul 25 12:44:27.102281 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 278/551] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:26 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:27.511258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:27.512175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:27.519411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.520692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.521618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:27.522112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:27.671699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.679981 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.681461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:27.682676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f6c03d63-d173-44a8-877a-c358e2aa9498 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.175617 Jul 25 12:44:27.683279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 274/552] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:27 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:28.132203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.133422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.141694 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.142271 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.143121 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.143733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.333531 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.341467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6678b0dc-50fa-4173-8c9c-db903ae0e01b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.214461 Jul 25 12:44:28.342353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 279/553] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:28 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:28.705799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:28.706431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:28.713843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.714324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.715098 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:28.715529 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:28.863693 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.872393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.874101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:28.875434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0d0daf8e-562a-41d4-ad07-fb30a57fa3da tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.173697 Jul 25 12:44:28.876069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 275/554] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:28 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:29.363190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:29.365349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:29.372118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.372564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.373322 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.373752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.517531 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:29.525642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bcad19b5-6ae2-478b-9938-c2d83e879e6f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.166734 Jul 25 12:44:29.526317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 280/555] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:29 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:29.898173 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:29.898775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:29.905625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.906116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:29.906885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:29.907341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.039205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.047219 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.048773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.050066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-51873bbf-20fe-43c0-8c99-ed5c37aa99d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.155722 Jul 25 12:44:30.050767 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 276/556] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:29 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:30.547092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:30.547710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:30.554294 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.554749 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.555515 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:30.555948 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:30.793734 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:30.801102 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bfc2c8e0-47a2-4fb4-b950-f4929b726e61 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.257907 Jul 25 12:44:30.801656 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 281/557] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:30 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:31.073797 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.074435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:31.080759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.081197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.081961 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.082453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.215779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.223798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.225289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:31.226483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-27ee412c-0a12-4001-ae4e-ffc297b4c35f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1739 microversion: 2.20 time: 0.156869 Jul 25 12:44:31.227029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 277/558] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:31 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:31.821675 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:31.822317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:31.829245 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.829811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:31.830714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:31.831274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.001274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.008958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b127900c-883d-4109-8ffd-6c7da10a94d3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.191094 Jul 25 12:44:32.009538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 282/559] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:31 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:32.249535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:32.250199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:32.257249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.257684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.258467 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:32.258895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:32.464010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.476920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.478451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:32.479648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3afbce41-efe6-4421-8d2c-b2e188405162 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1721 microversion: 2.20 time: 0.233975 Jul 25 12:44:32.480349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 278/560] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:32 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:33.030615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:33.031156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:33.039899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.040449 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.041466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.041774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.046629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:33.199924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:33.208396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c12166b7-c145-4791-9345-25be6a3798dd tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.181705 Jul 25 12:44:33.208982 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 283/561] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:33 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:33.504033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:33.505303 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:33.512023 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.512456 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.513213 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:33.513643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:33.659379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:33.670013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:33.671537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:33.672699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8f81268b-a74f-4bde-9860-549860dc1ac8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1721 microversion: 2.20 time: 0.172758 Jul 25 12:44:33.673264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 279/562] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:33 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:34.112964 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-ec8b855d-82ef-4788-a46f-425daec5966e req-c8798ab2-31e3-48f5-8e19-2a31fc26a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a118fe-83de-487b-baf3-8942c875079e", "name": "network-vif-plugged", "status": "completed", "tag": "f58b1b0c-4007-4e0a-bbb3-0de1556a42fd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:34.127025 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-ec8b855d-82ef-4788-a46f-425daec5966e req-c8798ab2-31e3-48f5-8e19-2a31fc26a5fc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.127697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-ec8b855d-82ef-4788-a46f-425daec5966e req-c8798ab2-31e3-48f5-8e19-2a31fc26a5fc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.141559 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-ec8b855d-82ef-4788-a46f-425daec5966e req-c8798ab2-31e3-48f5-8e19-2a31fc26a5fc service nova] Creating event network-vif-plugged:f58b1b0c-4007-4e0a-bbb3-0de1556a42fd for instance 70a118fe-83de-487b-baf3-8942c875079e on hv-cinder-82549 Jul 25 12:44:34.160010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-ec8b855d-82ef-4788-a46f-425daec5966e req-c8798ab2-31e3-48f5-8e19-2a31fc26a5fc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050869 Jul 25 12:44:34.160892 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 284/563] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:44:34.244962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:34.244962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.250903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.251620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.252422 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.252858 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.258281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:34.461109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.468813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f3a4659e-439d-42e7-93a0-7dbc44e252c2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.233166 Jul 25 12:44:34.469462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 280/564] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:34 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:34.702659 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:34.703372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.711535 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.712018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.712794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.713226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.864892 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.873075 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.874626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:34.875811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4e5f55ee-c883-4252-9fc3-8acf72a3bd9c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1724 microversion: 2.20 time: 0.179626 Jul 25 12:44:34.876627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 285/565] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:34 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:34.899351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84810991-ee98-4f29-9f3e-72c7b06559b5"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:34.901712 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:34.904192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:34.911707 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.912149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:34.912922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:34.913412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.330205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d1e27850-e39f-4676-9ae3-be63d495dd6e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.435444 Jul 25 12:44:35.330822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 281/566] 10.222.0.60 () {62 vars in 1364 bytes} [Mon Jul 25 12:44:34 2022] POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments => generated 188 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:44:35.460620 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:35.461216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.467677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.468115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.468872 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.469302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.497134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.497771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.507535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.508025 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.509874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.510365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.571234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d73460af-7e97-4719-8b9b-b1bd4af980a9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/action" status: 202 len: 0 microversion: 2.20 time: 0.114523 Jul 25 12:44:35.572114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 286/567] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Jul 25 12:44:35 2022] POST /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:44:35.580951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:35.581676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:35.588090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.588725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.589790 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:35.590139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:35.673709 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:35.683474 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-de6f87c6-53d7-4959-81c3-89360eb50eff tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.190393 Jul 25 12:44:35.686700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 282/568] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:35 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:44:35.741337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:35.750348 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:35.752011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:35.753345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7f9db073-a743-4cf4-a7e2-4d1bcf89d2ad tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1810 microversion: 2.20 time: 0.177010 Jul 25 12:44:35.754039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 287/569] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:35 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:36.197786 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-f78fb1f9-f2dc-4e74-b82b-6e9c0ce05b7e req-c8703fb2-afce-4064-a9e3-9c42ef606c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "name": "network-vif-unplugged", "status": "completed", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:36.208798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f78fb1f9-f2dc-4e74-b82b-6e9c0ce05b7e req-c8703fb2-afce-4064-a9e3-9c42ef606c6c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.209237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f78fb1f9-f2dc-4e74-b82b-6e9c0ce05b7e req-c8703fb2-afce-4064-a9e3-9c42ef606c6c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.222072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-f78fb1f9-f2dc-4e74-b82b-6e9c0ce05b7e req-c8703fb2-afce-4064-a9e3-9c42ef606c6c service nova] Creating event network-vif-unplugged:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:44:36.228730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-f78fb1f9-f2dc-4e74-b82b-6e9c0ce05b7e req-c8703fb2-afce-4064-a9e3-9c42ef606c6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034530 Jul 25 12:44:36.229332 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 283/570] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:44:36.706728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.707373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:36.714235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.714681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.715456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.715950 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.779440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:36.780142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:36.787514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.787988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.789049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:36.789475 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:36.869208 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.877210 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b012b912-17bd-4b3f-96ec-82166519c3fb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1366 microversion: 2.1 time: 0.174438 Jul 25 12:44:36.877815 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 288/571] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:36.928071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.936816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.938323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:36.939474 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0f707b99-30a0-43e7-9797-2d02de1f9ce8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1750 microversion: 2.20 time: 0.165028 Jul 25 12:44:36.940031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 284/572] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:36 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:37.898123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:37.898730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:37.905288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.905735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:37.906540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:37.906978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.044164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.054235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b812adde-1d54-485c-b501-d7f1eafb55a8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1556 microversion: 2.1 time: 0.159889 Jul 25 12:44:38.054823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 289/573] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:44:38.073134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:38.073744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:38.074392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:38.074919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:38.080134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.080586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.081366 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.081760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.081874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.082233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.083001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:38.083430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:38.164534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-db266e9f-3b4b-4e6f-9e62-046d8625549c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093801 Jul 25 12:44:38.165275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 290/574] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:44:38 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:44:38.217325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.227608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.228137 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:38.229300 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1a7eceb0-2294-4cc0-afd7-0fddbe4581ba tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1750 microversion: 2.20 time: 0.270341 Jul 25 12:44:38.229857 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 285/575] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:37 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:39.174693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-4b99db14-2b1f-4c48-91d9-017bac310b8b req-c3a7a561-d6b9-4dce-8a2e-542e467ab38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a118fe-83de-487b-baf3-8942c875079e", "tag": "f58b1b0c-4007-4e0a-bbb3-0de1556a42fd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:44:39.186083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-4b99db14-2b1f-4c48-91d9-017bac310b8b req-c3a7a561-d6b9-4dce-8a2e-542e467ab38f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:39.188483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-4b99db14-2b1f-4c48-91d9-017bac310b8b req-c3a7a561-d6b9-4dce-8a2e-542e467ab38f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:39.205564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-4b99db14-2b1f-4c48-91d9-017bac310b8b req-c3a7a561-d6b9-4dce-8a2e-542e467ab38f service nova] Creating event network-changed:f58b1b0c-4007-4e0a-bbb3-0de1556a42fd for instance 70a118fe-83de-487b-baf3-8942c875079e on hv-cinder-82549 Jul 25 12:44:39.210904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-4b99db14-2b1f-4c48-91d9-017bac310b8b req-c3a7a561-d6b9-4dce-8a2e-542e467ab38f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040614 Jul 25 12:44:39.211524 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 291/576] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:44:39.254613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:39.255415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:39.262913 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:39.263433 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:39.264271 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:39.264768 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:39.411048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.419764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.421490 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:39.422832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3c25338b-ae88-41e5-a271-729d50fe6691 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1750 microversion: 2.20 time: 0.172717 Jul 25 12:44:39.423445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 286/577] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:39 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:40.449377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:40.450265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:40.457971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.458447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.459249 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:40.459680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:40.607873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.616663 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.618163 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:40.619301 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f6c15bbc-f9f9-4382-a851-ee6c3fb4c454 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1750 microversion: 2.20 time: 0.175071 Jul 25 12:44:40.619854 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 292/578] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:40 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:41.644556 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:41.645875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:41.652678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.653122 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.653891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:41.654346 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:41.802086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:41.810737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:41.812238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:41.813393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-006f9e5d-cad6-4524-841b-dcd95036db5e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1750 microversion: 2.20 time: 0.172760 Jul 25 12:44:41.813983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 287/579] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:41 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:42.843657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:42.844320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:42.854529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:42.855078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:42.856186 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:42.856678 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:43.001883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:43.012445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:43.014447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:43.015686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9947c052-f270-4214-a7d4-19407f8d10d1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1752 microversion: 2.20 time: 0.178330 Jul 25 12:44:43.016265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 293/580] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:42 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:44.044056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:44.045700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:44.056816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.058341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.059315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:44.060199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:44.366417 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.378257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.380457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:44.382157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-88b7989e-6102-4dd0-9617-b87f2dd0a827 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1752 microversion: 2.20 time: 0.345513 Jul 25 12:44:44.382809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 288/581] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:44 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1752 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:45.416615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:45.417149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:45.424313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:45.424762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:45.425538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:45.426010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:45.600146 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:45.610226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:45.611824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:45.613366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0dfa156b-6ad4-4cc8-b360-accb00eb57e3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.200768 Jul 25 12:44:45.614431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 294/582] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:45 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:46.639513 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:46.640139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:46.647770 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.648285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.649116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:46.649741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:46.817126 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.829164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.831049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:46.832211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-97a4e115-aa3b-4520-97ae-1d76844f92cc tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.196766 Jul 25 12:44:46.833495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 289/583] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:46 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:47.859313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:47.860635 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:47.868288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.868735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:47.869519 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:47.869988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:48.030229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:48.039859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:48.041397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:48.042606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b5183f1f-66d6-4a81-9c86-7e59470e7600 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.187872 Jul 25 12:44:48.043171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 295/584] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:47 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:44:49.068444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:49.069250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:49.077325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:49.077820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:49.078714 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:49.079150 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:49.225444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:49.234329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:49.235805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:49.236939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-49a6c439-6a99-475c-8c53-534ed51ba6df tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.173683 Jul 25 12:44:49.237541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 290/585] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:49 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:50.260574 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:50.261207 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:50.268293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:50.268918 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:50.269822 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:50.270397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:50.422115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:50.431026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:50.432837 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:50.434025 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-27abf995-d960-465f-bd38-0fa7112a2cab tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.178014 Jul 25 12:44:50.434578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 296/586] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:50 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:51.457933 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:51.459747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:51.467514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.468519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.469883 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:51.470597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:51.633209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:51.657368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:51.658935 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:51.660845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2b7700ef-e556-46a3-959e-f98959d91bc0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.207478 Jul 25 12:44:51.661847 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 291/587] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:51 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:52.687300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:52.688935 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:52.696429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:52.696933 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:52.697862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:52.698426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:52.868471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:52.879973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:52.882264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:52.884453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-37ab5b67-a9ca-4a6d-b8a5-642c83696938 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.201070 Jul 25 12:44:52.885139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 297/588] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:52 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:53.912367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:53.913039 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:53.924505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.934698 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:53.935830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:53.936412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:54.210031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.236530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.238069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:54.239637 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-46e68240-fe0b-465a-ace8-94c6b0c36e18 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.331351 Jul 25 12:44:54.241225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 292/589] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:53 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:55.270171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:55.271069 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:55.278888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=54 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:55.281246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.282162 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.283299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:55.284002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:55.443658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:55.454224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:55.455979 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:55.457284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fa1349ae-f555-4e5d-8696-22062649d426 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.191587 Jul 25 12:44:55.458512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 298/590] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:55 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:56.482502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:56.483151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:56.502464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:56.503275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:56.504200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:56.504731 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:56.681323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.691894 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.694214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:56.695676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-151191f8-8799-4ad1-bd0d-ba605ebc8d36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.218193 Jul 25 12:44:56.696415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 293/591] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:56 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:57.721054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:57.721812 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:57.730362 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.730811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.731587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:57.732017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:57.893997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:57.904386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:57.906120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:57.907398 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d9021c30-d3d6-43cd-b1e7-4f40ce1bbab6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.190236 Jul 25 12:44:57.908046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 299/592] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:57 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:44:58.933195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:44:58.933811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:44:58.940334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:58.940778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:58.941559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:44:58.942036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:44:59.090977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:59.095095 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:59.103359 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:59.105166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:44:59.106532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-965f425d-368d-4bfd-9f85-683ccb359080 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.177649 Jul 25 12:44:59.107187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 294/593] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:44:58 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:00.133490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:00.134177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:00.140612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.141055 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.141816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:00.142280 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:00.157279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:00.293145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.306940 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.308679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:00.310066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e5467dc4-d66b-46de-8dea-62ede6d6eea8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.181067 Jul 25 12:45:00.310713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 300/594] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:00 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:45:01.339198 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:01.339881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:01.347262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:01.347713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:01.348481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:01.348915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:01.496226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:01.504967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:01.506498 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:01.508165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e8b18b14-2824-4871-9439-43ef26715d1d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.173763 Jul 25 12:45:01.508721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 295/595] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:01 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:02.539376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:02.540504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:02.550717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:02.551259 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:02.552125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:02.552697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:02.697797 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:02.708231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:02.710007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:02.711456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c735ecfc-f833-45a2-af35-25bc42ebe863 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.177313 Jul 25 12:45:02.712105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 301/596] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:02 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:03.738947 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:03.739568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:03.746773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.747217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.747980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:03.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:03.882347 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.891170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.892643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:03.893803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6f873402-910f-4d5e-889f-829c34201c89 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.159528 Jul 25 12:45:03.894395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 296/597] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:03 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:04.920354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:04.921269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:04.930762 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.931422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:04.932574 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:04.933212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:05.080603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:05.090859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:05.092385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:05.093541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c7c03f9f-de6f-4a8f-b62d-a4f72a67b46c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.180078 Jul 25 12:45:05.094136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 302/598] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:04 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:06.116654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:06.117265 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:06.119651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=32 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:06.125148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.125593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.126402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:06.126830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:06.269075 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:06.278267 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:06.279763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:06.280913 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9abcfd84-02ae-4ac4-a2d4-210deb5d9c62 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.168145 Jul 25 12:45:06.281479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 297/599] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:06 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:07.310874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:07.311505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:07.318074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.318516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.319275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:07.319704 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:07.461793 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:07.470677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:07.472176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:07.473336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2a1ee9ae-9e84-45fe-934c-db6606fd2317 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.166410 Jul 25 12:45:07.473892 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 303/600] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:07 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:08.499413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:08.499967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:08.506546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.506987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.507800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:08.508747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:08.644674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.653222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.654755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:08.655917 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c1922dc7-5863-4011-9e6d-9e50e83055f8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.160714 Jul 25 12:45:08.656483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 298/601] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:08 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:09.679571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:09.680787 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:09.687345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.687784 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.688544 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:09.688988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:09.826474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:09.835555 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:09.837618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:09.838880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-decb69a8-d5f4-40ac-a257-5f37d5e2d2a5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.163167 Jul 25 12:45:09.839711 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 304/602] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:09 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:10.862849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:10.863459 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:10.870734 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.871179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:10.871960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:10.872396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:11.008873 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.018206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.019725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:11.022106 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-47531a32-d6c6-480c-bbaa-64181e01c5a8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.162267 Jul 25 12:45:11.022106 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 299/603] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:10 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:12.043936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:12.044550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:12.051851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.052466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.053483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:12.054124 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:12.189598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.198820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.200312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:12.201459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-060cfac4-1b1d-4858-a557-f450c909468c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.161380 Jul 25 12:45:12.202025 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 305/604] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:12 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:13.228140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:13.228750 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:13.235622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.236058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.236819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:13.237246 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:13.385086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.393513 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.395055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:13.396177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6ee1315e-a79e-4a96-99ec-1ab992045849 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.173032 Jul 25 12:45:13.396732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 300/605] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:13 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:14.420125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:14.420729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:14.428693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:14.429214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:14.430044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:14.430483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:14.522101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-f170f3b5-0517-43b3-a660-e397676c2342 req-53703184-edd5-4783-afaf-da878bd6dc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "name": "network-vif-plugged", "status": "completed", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:14.535469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f170f3b5-0517-43b3-a660-e397676c2342 req-53703184-edd5-4783-afaf-da878bd6dc22 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:14.536019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-f170f3b5-0517-43b3-a660-e397676c2342 req-53703184-edd5-4783-afaf-da878bd6dc22 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:14.549338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-f170f3b5-0517-43b3-a660-e397676c2342 req-53703184-edd5-4783-afaf-da878bd6dc22 service nova] Creating event network-vif-plugged:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:45:14.556089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-f170f3b5-0517-43b3-a660-e397676c2342 req-53703184-edd5-4783-afaf-da878bd6dc22 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037453 Jul 25 12:45:14.557220 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 301/606] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:14.581202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:14.590628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:14.592243 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:14.593567 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e4a3cfbb-ceb0-4519-9bc1-be67dd3a3219 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.177244 Jul 25 12:45:14.595373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 306/607] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:14 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:15.621415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:15.622128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:15.628699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:15.629140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:15.629885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:15.630335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:15.768931 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:15.777641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:15.779181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:15.780337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6591eebf-99d4-4926-8031-e71117188ebe tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.163773 Jul 25 12:45:15.780881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 302/608] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:15 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:16.803114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:16.803706 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:16.811060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.811512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.812277 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:16.812697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:16.943750 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:16.952112 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:16.953621 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:16.954829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5c436f8b-c0ab-4fd6-bf6f-d65ca2c1d9c3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.155636 Jul 25 12:45:16.955391 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 307/609] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:16 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:17.978029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:17.978620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:17.985547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.986027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:17.986796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:17.987225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:18.128761 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.140083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.141557 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:18.142739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ea18b3fa-72b5-403c-9fc3-6ad06385f515 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1808 microversion: 2.20 time: 0.168710 Jul 25 12:45:18.143293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 303/610] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:17 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:19.167167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:19.167828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:19.174390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.174834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.175599 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:19.176031 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:19.308934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.317597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.319117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:19.320837 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d5812a33-1f66-4f3d-8fed-69f0cf6102d6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1795 microversion: 2.20 time: 0.158091 Jul 25 12:45:19.321384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 308/611] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:45:19 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:45:31.739181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=13 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:31.739907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=50 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:31.902387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef09a114-a8ab-46ce-a437-d2b6e2cacb1e"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:31.904798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:31.910706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.911148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:31.911899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:31.912328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:32.181488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-135a1888-91ba-428d-b5ab-0a882fca5357 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446941 Jul 25 12:45:32.182338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 304/612] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:45:31 2022] POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:45:39.760156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:39.762411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:39.764444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=21 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:39.765094 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=51 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:39.771118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.771564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.772330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.772766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.795478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lazy-loading 'flavor' on Instance uuid 64f4b7b4-6156-4da3-a667-d2bd66332366 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:45:39.916361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5df12288-04f4-4a70-b9ae-4fec204a4a91 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/action" status: 200 len: 32 microversion: 2.1 time: 0.160733 Jul 25 12:45:39.916887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 309/613] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:39 2022] POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:45:39.927401 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:39.928094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:39.934904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.935355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:39.936118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:39.936560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.150913 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.158973 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-033d74b0-e311-4e6d-a892-8fc3e9730514 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.236131 Jul 25 12:45:40.159549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 305/614] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:39 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:40.590817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:40.593195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.600116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.600662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.602166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.602607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.695700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c8585259-17cd-432b-bb0f-9f34b181f388 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action" status: 202 len: 0 microversion: 2.1 time: 0.109571 Jul 25 12:45:40.696350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 310/615] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:40 2022] POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:45:40.704765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:40.705298 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:40.712483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.712987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.713682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:40.714136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:40.874120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:40.884555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c8f09bdd-cf1b-4fd0-a321-2f8ae75b3f0b tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1752 microversion: 2.1 time: 0.182612 Jul 25 12:45:40.885146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 306/616] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:40 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:41.181623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:41.182341 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:41.188857 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.189310 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.190118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.190552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.338882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:41.347040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fb046edc-59c4-47b4-906c-841043a5455b tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.170135 Jul 25 12:45:41.347616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 311/617] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:41 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:41.906336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:41.906957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:41.913307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.914324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:41.915145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:41.915571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.055149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:42.063375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-27f19f0f-ca60-4385-aebe-9f4fde12ea69 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.160855 Jul 25 12:45:42.063939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 307/618] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:41 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:42.368612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:42.369197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:42.375823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.376289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.377050 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:42.377509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:42.513413 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:42.521472 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0b4bc379-af4a-40a7-8673-6235ee18e2c7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.157194 Jul 25 12:45:42.522054 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 312/619] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:42 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:43.084674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:43.085247 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:43.092213 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.092649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.093393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.093818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.240335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.248706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-78fbf58e-33c0-4c22-9851-e2be4158999f tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.167811 Jul 25 12:45:43.249668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 308/620] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:43 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:43.543677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:43.544513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:43.550973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.551406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.552158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:43.552586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:43.686832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:43.694647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0d974189-dd12-4e3c-a514-2d31a2803183 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.154878 Jul 25 12:45:43.695888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 313/621] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:43 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:44.271336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:44.271923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:44.278877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.279329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.280080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.280663 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.426707 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:44.434881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-91514383-cb5e-40d7-991b-4b0ef152a3db tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.167388 Jul 25 12:45:44.435462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 309/622] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:44 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:44.717182 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:44.717873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:44.724470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.724911 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.725680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:44.726661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:44.857227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:44.865364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7692676f-1edc-4874-9515-17548ae11c64 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.152053 Jul 25 12:45:44.865946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 314/623] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:44 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:45.456450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.456997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.464144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.464582 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.465333 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.465759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.617106 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:45.626535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7aed16ef-0422-460b-b599-a62f8a6ac225 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.173981 Jul 25 12:45:45.627124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 310/624] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:45.889562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:45.890208 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:45.896773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.897209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:45.898007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:45.898450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:46.027130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:46.035038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-335d7fc5-d9e7-4739-96d9-065cac64483e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.149962 Jul 25 12:45:46.035622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 315/625] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:45 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:46.649049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:46.649634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:46.656190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:46.656633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:46.657382 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:46.657808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:46.797633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:46.805593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1dba52d3-36e0-4d6e-ade6-bec758692e9c tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.160927 Jul 25 12:45:46.806166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 311/626] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:46 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:47.056755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:47.057501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:47.064261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.064714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.065491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.065945 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.199374 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:47.207698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5baf9d1f-61c7-4ad7-9e38-6f178835cdf2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.155151 Jul 25 12:45:47.208276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 316/627] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:47 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:47.826943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:47.827550 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:47.834038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.834485 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.835240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:47.836254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:47.982535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:47.990704 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8d233ce1-a15c-43f0-9456-0af951c708e6 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.167663 Jul 25 12:45:47.991268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 312/628] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:47 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:48.230109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:48.230722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:48.237480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.237935 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.238716 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:48.239173 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:48.366995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:48.374746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cc626abc-df8e-494f-95f7-bebfadef0eda tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.149017 Jul 25 12:45:48.375312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 317/629] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:48 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:49.013342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:49.013888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:49.020307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.020745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.021489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.021930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.165468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:49.173355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cf8e16b2-282e-4893-a138-bdaca92f4bfa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.163792 Jul 25 12:45:49.173941 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 313/630] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:49 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:49.396226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:49.396852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:49.403389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.403829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.404841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:49.405279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:49.537363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:49.545884 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-102e0a13-3f6b-43a4-a4d3-ed758fa80a90 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.153576 Jul 25 12:45:49.546482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 318/631] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:49 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:50.194406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:50.195522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:50.201857 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.202414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.203159 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.203583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.347062 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:50.354934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-72a3bf9a-285a-4fde-93d9-8118818ce7e2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.164374 Jul 25 12:45:50.355502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 314/632] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:50 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:50.566872 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:50.567523 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:50.574758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.575202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.575954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:50.576389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:50.702943 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:50.710793 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b180e6ae-a18a-451c-8916-1297d9f9474a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.147833 Jul 25 12:45:50.711364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 319/633] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:50 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.376563 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.377199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.384128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.384567 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.385319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.385752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.531240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.539930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-832d86d1-db52-4106-96f6-344fe4a7e805 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.166884 Jul 25 12:45:51.540838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 315/634] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:51.732236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:51.732800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:51.739667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.740114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.740907 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:51.741341 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:51.869941 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:51.878088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3701815f-69fc-4a40-be84-9e49346d8f8c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.149812 Jul 25 12:45:51.878662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 320/635] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:51 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:52.560832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.561557 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.568212 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.568648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.569409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.569839 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.709808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:52.718310 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-be9a847b-d1d8-457c-a810-5acb5f66703e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.161373 Jul 25 12:45:52.718870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 316/636] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:52.900319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:52.900867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:52.907104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.907542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:52.908295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:52.908722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.037500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.045991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7ccab9b8-8ea2-4df8-8051-e8f9c96c014a tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.149750 Jul 25 12:45:53.046581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 321/637] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:52 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:53.740001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:53.740627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:53.747093 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.747533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.748326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:53.748789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:53.888815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:53.897268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-05d02d0e-5394-4698-866b-e311566d10d9 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1757 microversion: 2.1 time: 0.161113 Jul 25 12:45:53.897837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 317/638] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:53 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:54.070685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.071305 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.077676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.078156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.078941 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.079373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.096848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:54.213439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:54.221651 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-259318b8-e70b-44da-8169-843b856d432c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.155536 Jul 25 12:45:54.222296 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 322/639] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:54.923342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:54.923864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:54.930318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.930754 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:54.931535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:54.931960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.072700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.080603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b2ff3190-8889-47b0-895c-62d73edcb2fa tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1760 microversion: 2.1 time: 0.161144 Jul 25 12:45:55.081199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 318/640] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:54 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:55.243833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:55.244458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:55.251181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.251624 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.252405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:55.252830 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:55.392108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:55.400672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c21d16f2-4e22-4c07-b224-071eca523123 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1734 microversion: 2.1 time: 0.160686 Jul 25 12:45:55.401468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 323/641] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:55 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:45:56.422318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.422939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.430191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.430662 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.431440 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.431871 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.436191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:56.575277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:56.589514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7a4c7d47-f5ad-49e1-9293-0ed0dc7046ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1714 microversion: 2.1 time: 0.170600 Jul 25 12:45:56.590603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 319/642] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1714 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:56.655147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.655667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.662132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.662584 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.663351 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.663826 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.746780 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] HTTP exception thrown: Cannot 'detach_volume' instance 64f4b7b4-6156-4da3-a667-d2bd66332366 while it is in vm_state rescued Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Request method failure captured: Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments/ef09a114-a8ab-46ce-a437-d2b6e2cacb1e HTTP/1.1 Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8EmIKYVgzQNF9TKVx9CaU6EWQ9y_NXh7bqWeTEpX86Zj-l1LZHIAB537TxjOMD1kS8BKaoM-y0h1BR7YQeZvIYghVXBTComBdqNksuv2OU6X3Dv4ZngkRBOXNAPKBDSUM_JlFtoFHt0Lg8pBZmGmmkJ8yFs8crUHtCVth7L421EUY Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:45:56.748411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b0ca10639aa47dea81db9799273acba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: e56531920fc548a3a37f63ca0d1e5d82 Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:45:56.750010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Cannot 'detach_volume' instance 64f4b7b4-6156-4da3-a667-d2bd66332366 while it is in vm_state rescued Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'server_id': '64f4b7b4-6156-4da3-a667-d2bd66332366', 'id': 'ef09a114-a8ab-46ce-a437-d2b6e2cacb1e'} Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:45:56.750760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 64f4b7b4-6156-4da3-a667-d2bd66332366 while it is in vm_state rescued Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 64f4b7b4-6156-4da3-a667-d2bd66332366 while it is in vm_state rescued Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:45:56.752299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Returning 409 to user: Cannot 'detach_volume' instance 64f4b7b4-6156-4da3-a667-d2bd66332366 while it is in vm_state rescued {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:45:56.753496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b8ad9007-d603-4ed5-a953-4ad9117aca29 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments/ef09a114-a8ab-46ce-a437-d2b6e2cacb1e" status: 409 len: 152 microversion: 2.1 time: 0.098761 Jul 25 12:45:56.753496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 324/643] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:45:56 2022] DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments/ef09a114-a8ab-46ce-a437-d2b6e2cacb1e => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 12:45:56.759367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:45:56.759897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.765991 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.766439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.767194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.767623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.833650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-50bd9f8b-b94a-45c9-ad0c-9583bafc4770 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/action" status: 202 len: 0 microversion: 2.1 time: 0.078430 Jul 25 12:45:56.834553 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 320/644] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:45:56 2022] POST /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:45:56.843570 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:56.844140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:56.850794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.851474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:56.852214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:56.852645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:57.001662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:57.010116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9c1276b9-b933-4c9e-b57b-b69c503332e5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1722 microversion: 2.1 time: 0.170408 Jul 25 12:45:57.010974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 325/645] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:56 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:58.033252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:58.033992 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:58.041172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.041612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:58.042394 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:58.042820 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:58.188663 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:58.197834 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7614a70b-c5c2-4ebb-a8c0-48118abe2a36 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1722 microversion: 2.1 time: 0.168745 Jul 25 12:45:58.198450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 321/646] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:58 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:45:59.230759 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:45:59.231344 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:45:59.238213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.238653 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.239403 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:45:59.239863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:45:59.378153 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:45:59.386984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e7a35834-8932-44a5-9502-7cb844d91b7e tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1722 microversion: 2.1 time: 0.164968 Jul 25 12:45:59.387558 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 326/647] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:45:59 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:00.414841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:00.415807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:00.425279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.426100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.427339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:00.428069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:00.810408 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:00.819151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3c32452b-e862-459f-ab47-ba41c8f081e2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1722 microversion: 2.1 time: 0.410483 Jul 25 12:46:00.819723 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 322/648] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:00 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:01.841595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:01.842445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:01.849104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.849547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:01.850426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:01.850855 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.001252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:02.010017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6c3b00f3-dae9-4871-aa27-f264c217769d tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1728 microversion: 2.1 time: 0.172240 Jul 25 12:46:02.010602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 327/649] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:01 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:02.038465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:02.039302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:02.041447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=39 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:02.047230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.047686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.048462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:02.048892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:02.129156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0620e380-92f8-4e2d-b202-bd9fde1928dc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094198 Jul 25 12:46:02.130273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 323/650] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:46:02 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:03.371321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-d4833a8c-5870-4088-a9fb-c51bc0f2e130 req-fc9f5d96-853b-4792-9568-6e18cb65aa44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:03.381598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d4833a8c-5870-4088-a9fb-c51bc0f2e130 req-fc9f5d96-853b-4792-9568-6e18cb65aa44 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:03.382591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d4833a8c-5870-4088-a9fb-c51bc0f2e130 req-fc9f5d96-853b-4792-9568-6e18cb65aa44 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:03.397149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-d4833a8c-5870-4088-a9fb-c51bc0f2e130 req-fc9f5d96-853b-4792-9568-6e18cb65aa44 service nova] Creating event network-changed:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:46:03.405963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-d4833a8c-5870-4088-a9fb-c51bc0f2e130 req-fc9f5d96-853b-4792-9568-6e18cb65aa44 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108418 Jul 25 12:46:03.407028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 328/651] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:05.420952 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-a49ab5cf-b92c-40c3-9bb9-f34ff520d338 req-6f005eba-b41b-4fb6-8720-a54abde0d5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:05.431736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-a49ab5cf-b92c-40c3-9bb9-f34ff520d338 req-6f005eba-b41b-4fb6-8720-a54abde0d5cc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:05.432217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-a49ab5cf-b92c-40c3-9bb9-f34ff520d338 req-6f005eba-b41b-4fb6-8720-a54abde0d5cc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:05.446859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-a49ab5cf-b92c-40c3-9bb9-f34ff520d338 req-6f005eba-b41b-4fb6-8720-a54abde0d5cc service nova] Creating event network-changed:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:46:05.458781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-a49ab5cf-b92c-40c3-9bb9-f34ff520d338 req-6f005eba-b41b-4fb6-8720-a54abde0d5cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036463 Jul 25 12:46:05.459532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 324/652] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:21.463815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:46:21.465503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 12:46:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:46:21.471159 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=40 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:21.471902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=34 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:21.587642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:21.588514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.596095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.596542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.597308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.597737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.620949 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-09a4d077-69e4-4c47-9c82-a03515a391ab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/ips" status: 200 len: 149 microversion: 2.1 time: 0.151342 Jul 25 12:46:21.621500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 329/653] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:46:21 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/ips => generated 149 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:21.632643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:21.633410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:21.637659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e36faab5-b15d-4563-b0ee-1586bf6caa6e"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:21.640176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.647895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.648337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.649102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.649530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.731226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: POST /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/os-volume_attachments HTTP/1.1 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 74 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:46:21.733186 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {"volumeAttachment": {"volumeId": "e36faab5-b15d-4563-b0ee-1586bf6caa6e"}} Jul 25 12:46:21.735235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'server_id': '70a118fe-83de-487b-baf3-8942c875079e', 'body': {'volumeAttachment': {'volumeId': 'e36faab5-b15d-4563-b0ee-1586bf6caa6e'}}} Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.736222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:21.738082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 400 to user: Invalid volume: volume e36faab5-b15d-4563-b0ee-1586bf6caa6e is already attached to instances: eb0e67fb-85b0-495f-82fa-816792a84b43 {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8ce4449e-d498-4366-a298-70d622547eab tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104034 Jul 25 12:46:21.739920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 325/654] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:46:21 2022] POST /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:21.743670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:21.744165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.750196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.750648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.751409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.751849 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.777497 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:21.859448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c03efd9b-92f5-4f8b-ad5b-371bbbbe49bf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 204 len: 0 microversion: 2.1 time: 0.119183 Jul 25 12:46:21.859959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 330/655] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:21 2022] DELETE /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:21.870181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:21.870806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:21.879604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.880047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:21.880940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:21.881507 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:22.021294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:22.029361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e0092cd8-a583-4ec1-9887-94ac07b0aa37 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1680 microversion: 2.1 time: 0.163524 Jul 25 12:46:22.029990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 326/656] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:21 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:23.053711 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:23.054406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:23.060987 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:23.061423 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.062213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:23.063011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:23.201948 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:23.210231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-42092f93-8992-4206-b85c-de62bb8ea335 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1680 microversion: 2.1 time: 0.160320 Jul 25 12:46:23.210811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 331/657] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:23 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:24.235927 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:24.236937 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:24.244878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.245237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.246048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:24.246484 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:24.734661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:24.746349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a3a89728-52dc-4215-b654-fc166939e071 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1680 microversion: 2.1 time: 0.516828 Jul 25 12:46:24.747427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 327/658] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:24 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1680 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:25.285011 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-a74608cc-27b3-4d06-abe4-c8385878a153 req-71ac52e9-5ec4-403a-8d0b-960b95b8c9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a118fe-83de-487b-baf3-8942c875079e", "name": "network-vif-deleted", "tag": "f58b1b0c-4007-4e0a-bbb3-0de1556a42fd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:25.299567 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a74608cc-27b3-4d06-abe4-c8385878a153 req-71ac52e9-5ec4-403a-8d0b-960b95b8c9b4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.300310 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a74608cc-27b3-4d06-abe4-c8385878a153 req-71ac52e9-5ec4-403a-8d0b-960b95b8c9b4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.319207 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-a74608cc-27b3-4d06-abe4-c8385878a153 req-71ac52e9-5ec4-403a-8d0b-960b95b8c9b4 service nova] Creating event network-vif-deleted:f58b1b0c-4007-4e0a-bbb3-0de1556a42fd for instance 70a118fe-83de-487b-baf3-8942c875079e on hv-cinder-82549 Jul 25 12:46:25.328694 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-a74608cc-27b3-4d06-abe4-c8385878a153 req-71ac52e9-5ec4-403a-8d0b-960b95b8c9b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046667 Jul 25 12:46:25.330439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 332/659] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:25.777083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:25.779323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:25.792056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.793206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.795187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.796253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.867708 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:25.868851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:25.869905 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'fault' on Instance uuid 70a118fe-83de-487b-baf3-8942c875079e {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:25.945847 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:25.968597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0ddc488f-70d3-440c-b86b-365da1834a2d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 200 len: 1331 microversion: 2.1 time: 0.197967 Jul 25 12:46:25.970248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 328/660] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:25 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 1331 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:27.000292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.001206 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:27.008987 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.009431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.010223 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.010655 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.025058 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e HTTP/1.1 Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:46:27.026731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:46:27.028325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '70a118fe-83de-487b-baf3-8942c875079e'} Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:27.032376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:46:27.036701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:27.039593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:27.039593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9b4fc977-d32b-48e2-a065-ea12c73a937c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 404 len: 111 microversion: 2.1 time: 0.034024 Jul 25 12:46:27.039593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 333/661] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:26 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:27.039998 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2f5aca23-3888-4a5c-a194-90cf2060ace8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '.version_select at 0x7f4c2d4f9040>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.060928 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2f5aca23-3888-4a5c-a194-90cf2060ace8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023824732" status: 202 len: 0 microversion: 2.1 time: 0.027559 Jul 25 12:46:27.061648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 329/662] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Jul 25 12:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023824732 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:46:27.815971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.816460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:27.822677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.823125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.823887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:27.824318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:27.904693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'services' on Instance uuid eb0e67fb-85b0-495f-82fa-816792a84b43 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:27.978718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b5e79f3a-1d70-4738-a234-da56d7404b20 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments/e36faab5-b15d-4563-b0ee-1586bf6caa6e" status: 202 len: 0 microversion: 2.1 time: 0.166168 Jul 25 12:46:27.979308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 334/663] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:46:27 2022] DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments/e36faab5-b15d-4563-b0ee-1586bf6caa6e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:27.989462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:27.991711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:27.999549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:28.000761 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:28.001760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:28.002407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:28.036171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-efbbdf36-9579-41e4-8ea8-87582b073887 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051105 Jul 25 12:46:28.036838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 330/664] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:46:27 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:29.049608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.051995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.059419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.059856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.061005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.061374 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.091729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-22ec1bcf-ad50-457d-96a1-5ab4ea903a0d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046522 Jul 25 12:46:29.092312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 335/665] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:46:29 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:46:29.155996 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.156563 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.164008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.164470 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.165232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.165659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.191934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:29.279868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-db021376-fb25-4785-8746-0213e9f874a1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 204 len: 0 microversion: 2.1 time: 0.127310 Jul 25 12:46:29.280399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 331/666] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:46:29 2022] DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:29.289100 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:29.289724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:29.295800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.296240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.296992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:29.297419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:29.429272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:29.437300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bfaa5362-fe15-4242-aae2-5d36191ab259 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1681 microversion: 2.1 time: 0.152559 Jul 25 12:46:29.437867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 336/667] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:29 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:30.458900 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:30.460897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:30.467653 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:30.468168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:30.468961 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:30.469392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:30.710120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:30.718370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0bc00af9-1d67-43f5-a9cc-bb54b16b8152 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1681 microversion: 2.1 time: 0.263552 Jul 25 12:46:30.719174 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 332/668] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:30 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:31.393348 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-66e99701-96c9-43c3-929f-da1339c7fe30 req-13d13152-a395-4a13-bd19-0845afb59f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb0e67fb-85b0-495f-82fa-816792a84b43", "name": "network-vif-deleted", "tag": "ed8c1b70-0793-46e8-96ee-8e247d00d8a4"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:31.403648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-66e99701-96c9-43c3-929f-da1339c7fe30 req-13d13152-a395-4a13-bd19-0845afb59f19 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.404081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-66e99701-96c9-43c3-929f-da1339c7fe30 req-13d13152-a395-4a13-bd19-0845afb59f19 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.417553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-66e99701-96c9-43c3-929f-da1339c7fe30 req-13d13152-a395-4a13-bd19-0845afb59f19 service nova] Creating event network-vif-deleted:ed8c1b70-0793-46e8-96ee-8e247d00d8a4 for instance eb0e67fb-85b0-495f-82fa-816792a84b43 on hv-cinder-82549 Jul 25 12:46:31.423889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-66e99701-96c9-43c3-929f-da1339c7fe30 req-13d13152-a395-4a13-bd19-0845afb59f19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034171 Jul 25 12:46:31.424608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 337/669] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:31.740580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:31.741297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:31.747826 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.748264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.749010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.749436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.780784 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:31.781222 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:31.781663 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'fault' on Instance uuid eb0e67fb-85b0-495f-82fa-816792a84b43 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:31.803471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:46:31.803471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:46:31.822443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:31.830555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ce6fd65a-09d3-425e-a997-ad52eeb1fecc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 200 len: 1330 microversion: 2.1 time: 0.093291 Jul 25 12:46:31.830753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 333/670] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:31 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 1330 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:32.853520 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:32.854238 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:32.860755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:32.861199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:32.862016 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:32.862448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:32.875980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 HTTP/1.1 Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:46:32.877563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:46:32.879052 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'eb0e67fb-85b0-495f-82fa-816792a84b43'} Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:32.879794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:46:32.881317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:32.882626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:32.882626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7b53b214-075f-4512-a488-b3e1972f18f2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 404 len: 111 microversion: 2.1 time: 0.030853 Jul 25 12:46:32.882626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 338/671] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:32 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:46:32.888171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-163f5116-9455-4b43-8291-708ee824bf74 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '.version_select at 0x7f4c2d548820>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:32.907575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-163f5116-9455-4b43-8291-708ee824bf74 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495174351" status: 202 len: 0 microversion: 2.1 time: 0.023061 Jul 25 12:46:32.908157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 334/672] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Jul 25 12:46:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495174351 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:46:33.521844 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1816d76e-aa64-42c4-83b0-8efcb2f903f9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: .version_select at 0x7f4c2d33edc0>, body: {"keypair": {"name": "tempest-keypair-1231426977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMKPGWoRu5Bc7tCeSC1NcMP4QMYAMPJd2xDO9jjl23xllu79PKibHw/0AU4p4qD7SZJJVtKYlVAhpRIG94sBTLtICt1nFRytnT2gRojuJKuK2R5d0geT8iIaepTvF5RAA=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:33.537840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-1816d76e-aa64-42c4-83b0-8efcb2f903f9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:33.541633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-1816d76e-aa64-42c4-83b0-8efcb2f903f9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:33.566278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1816d76e-aa64-42c4-83b0-8efcb2f903f9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048331 Jul 25 12:46:33.566889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 339/673] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:46:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:34.770204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-7969119", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4181ae2d-cd73-4cb4-a9d0-f28fef05143a"}], "security_groups": [{"name": "tempest-securitygroup--1652749004"}], "key_name": "tempest-keypair-1231426977", "user_data": "}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:34.883099 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] validate_networks() for [('4181ae2d-cd73-4cb4-a9d0-f28fef05143a', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:46:35.321471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:46:35.321471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:46:35.321471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:46:35.321471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:46:35.321471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:46:35.330428 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.330868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.331657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.332143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.348859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:35.352752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:35.363668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:46:35.366442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:46:35.413093 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c1b871f8-0803-4d75-b73e-fd7e987afb11 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647526 Jul 25 12:46:35.413732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 335/674] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:46:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:46:35.424860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5ed5fad2-8f24-4080-acdb-182da63c4a0c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:35.425461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5ed5fad2-8f24-4080-acdb-182da63c4a0c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:35.482613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5ed5fad2-8f24-4080-acdb-182da63c4a0c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:35.489596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5ed5fad2-8f24-4080-acdb-182da63c4a0c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1239 microversion: 2.1 time: 0.068969 Jul 25 12:46:35.490197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 340/675] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:35 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:35.899585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:35.900691 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:35.907012 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.907453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.908206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:35.908629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:35.940331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-97f0165d-1107-4beb-bade-9a50c8d54cfa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments/84810991-ee98-4f29-9f3e-72c7b06559b5" status: 200 len: 194 microversion: 2.20 time: 0.045302 Jul 25 12:46:35.940937 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 336/676] 10.222.0.60 () {60 vars in 1454 bytes} [Mon Jul 25 12:46:35 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments/84810991-ee98-4f29-9f3e-72c7b06559b5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:36.009900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:36.010445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:36.016489 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.016937 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.017698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.018155 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.101779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lazy-loading 'services' on Instance uuid 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:46:36.183808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a4aa91c7-1752-4e19-9496-00a4e84484f1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments/84810991-ee98-4f29-9f3e-72c7b06559b5" status: 202 len: 0 microversion: 2.20 time: 0.177698 Jul 25 12:46:36.184410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 341/677] 10.222.0.60 () {60 vars in 1457 bytes} [Mon Jul 25 12:46:36 2022] DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments/84810991-ee98-4f29-9f3e-72c7b06559b5 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:46:36.192844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:36.195461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:36.202447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.202899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.203669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.204104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.236406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-00bf7dde-9edd-46a4-93fa-3a9960761501 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047540 Jul 25 12:46:36.236963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 337/678] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Jul 25 12:46:36 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:36.513056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:36.513747 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:36.521063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.521509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.522871 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:36.523305 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:36.588331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:36.595870 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-24ac0eb8-6c7e-46e3-b637-e668a6cda042 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1299 microversion: 2.1 time: 0.087035 Jul 25 12:46:36.596433 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 342/679] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:36 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:37.248647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:37.251048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:37.258225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:37.258669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:37.259427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:37.259856 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:37.292111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7294b0fc-7e1e-40b1-b94e-03616a4d0cb8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047347 Jul 25 12:46:37.292672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 338/680] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Jul 25 12:46:37 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:46:37.617193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:37.617904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:37.624386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:37.624766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:37.625524 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:37.625974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:37.687772 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:37.696604 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f949ffd9-b3a8-496f-a421-86b7a05e97db tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1297 microversion: 2.1 time: 0.083823 Jul 25 12:46:37.697180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 343/681] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:37 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:38.304198 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:38.306325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:38.312736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.313173 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.313955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.314384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.342287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1b754228-7165-494e-859c-654e4ddb7e71 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042035 Jul 25 12:46:38.342845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 339/682] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Jul 25 12:46:38 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:38.403921 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:38.404417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:38.410443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.411098 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.412019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.412606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.439346 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:46:38.534367 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b872f7ee-7139-4f2d-a6f1-1ef6acba570f tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 204 len: 0 microversion: 2.20 time: 0.133924 Jul 25 12:46:38.535630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 344/683] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Jul 25 12:46:38 2022] DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:46:38.544019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:38.544813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:38.551052 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.551674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.552660 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.553090 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.717399 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:38.718144 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:38.724473 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.724912 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.725700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.726150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.765041 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:38.774688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:38.776305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:38.777549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d5578f10-30c9-4094-95bb-d75d2313061a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.237378 Jul 25 12:46:38.778371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 340/684] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:38 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:38.837724 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-9df69aae-9ab1-4426-b1ad-17e3ccba1a89 req-0e6ae965-b38c-409d-9291-bd6b4a9e22aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988137c-976e-4521-b83a-c05377c0eeb7", "tag": "9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:38.847890 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-9df69aae-9ab1-4426-b1ad-17e3ccba1a89 req-0e6ae965-b38c-409d-9291-bd6b4a9e22aa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:38.848565 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-9df69aae-9ab1-4426-b1ad-17e3ccba1a89 req-0e6ae965-b38c-409d-9291-bd6b4a9e22aa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:38.865368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-9df69aae-9ab1-4426-b1ad-17e3ccba1a89 req-0e6ae965-b38c-409d-9291-bd6b4a9e22aa service nova] Creating event network-changed:9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b for instance 1988137c-976e-4521-b83a-c05377c0eeb7 on hv-cinder-82549 Jul 25 12:46:38.870595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-9df69aae-9ab1-4426-b1ad-17e3ccba1a89 req-0e6ae965-b38c-409d-9291-bd6b4a9e22aa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037894 Jul 25 12:46:38.871202 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 341/685] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:38.899337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:38.902991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:38.908490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1179b1f5-01f5-48e6-887a-19cb89ed790a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.195425 Jul 25 12:46:38.909229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 345/686] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:38 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:39.802143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.802830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:39.810190 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.810629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.811376 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.811800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.829667 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:39.931504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:39.932297 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:39.940064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.940658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.941548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:39.943030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:39.945492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.956193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.957687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:39.958877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-20949254-bcdb-418d-9df7-babe34635c8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.160994 Jul 25 12:46:39.959455 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 342/687] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:40.077196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:40.084738 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4da61442-9b9e-4d30-9ab2-ada07b26b84b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.158487 Jul 25 12:46:40.085321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 346/688] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:39 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:40.983278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:40.983896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:40.991290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.991851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:40.992662 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:40.993089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.105153 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:41.105810 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:41.113129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.113484 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.114268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:41.114697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:41.260580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:41.268651 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5f29f56a-28e3-4608-b486-a3f6e6c39e8c tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.167535 Jul 25 12:46:41.269235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 347/689] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:41 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:41.273040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:41.284177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:41.286399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:41.288515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-33ca637b-69e9-4c4e-bc26-b7d880159ad8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1723 microversion: 2.20 time: 0.308610 Jul 25 12:46:41.295141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 343/690] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:40 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:42.038548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-5fc1b35e-e675-4345-b904-0606e4fbcea9 req-954f27d8-908e-4f0b-9f52-d5a8ff37a10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf", "name": "network-vif-deleted", "tag": "7e8c3b73-d8a2-485a-92ed-56ba7473deac"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:42.050498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-5fc1b35e-e675-4345-b904-0606e4fbcea9 req-954f27d8-908e-4f0b-9f52-d5a8ff37a10b service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.050929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-5fc1b35e-e675-4345-b904-0606e4fbcea9 req-954f27d8-908e-4f0b-9f52-d5a8ff37a10b service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.065329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-5fc1b35e-e675-4345-b904-0606e4fbcea9 req-954f27d8-908e-4f0b-9f52-d5a8ff37a10b service nova] Creating event network-vif-deleted:7e8c3b73-d8a2-485a-92ed-56ba7473deac for instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf on hv-cinder-82549 Jul 25 12:46:42.070693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-5fc1b35e-e675-4345-b904-0606e4fbcea9 req-954f27d8-908e-4f0b-9f52-d5a8ff37a10b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Jul 25 12:46:42.071514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 348/691] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:42.291100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:42.291772 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:42.298687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.299127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.299938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.300365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.310381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:42.315080 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:42.317807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.318290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.319148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:42.319636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:42.389432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:42.400936 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:42.402458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:42.403627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a8cfc79f-c686-49b5-a19d-5021a85c7ffd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1655 microversion: 2.20 time: 0.097535 Jul 25 12:46:42.407783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 349/692] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:42 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:46:42.441011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:42.449448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-90b73ff8-ab62-4eb8-9a4c-331af9aec1eb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.162776 Jul 25 12:46:42.450508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 344/693] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:42 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:43.426914 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:43.427453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:43.434462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.434900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.435643 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.436069 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.470780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:43.471370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:43.478393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.478828 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.479581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:43.480451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:43.500923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:43.509087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:43.510687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:43.511829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6e9f18d2-870e-47af-bdad-d43307986a3b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1655 microversion: 2.20 time: 0.088993 Jul 25 12:46:43.512397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 350/694] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:43 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:43.609998 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:43.617239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9824e389-132a-492b-b27d-3fdb94081251 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.150221 Jul 25 12:46:43.617811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 345/695] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:43 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:44.535748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:44.536286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:44.542852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.543292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.544039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.544465 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.633459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:44.640994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:44.640994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:44.644965 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:44.647005 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.647346 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:44.647602 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.648429 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:44.648698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8e7ab709-4e0c-4302-aeeb-ca5fdd009c53 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 200 len: 1366 microversion: 2.20 time: 0.117299 Jul 25 12:46:44.649802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 351/696] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:44 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:44.650748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:44.830121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:44.842406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bd6139ca-f6cf-418e-8d95-e26f5253187f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.207665 Jul 25 12:46:44.843125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 346/697] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:44 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:46:45.676913 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.677536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:45.679401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:45.685180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.685629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:45.686426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.686863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:45.701620 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf HTTP/1.1 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:46:45.703307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:46:45.705013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf'} Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:46:45.706012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:46:45.707435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:46:45.709006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:46:45.709006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6196ff77-75c0-4459-b60b-883f2e6c3fb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 404 len: 111 microversion: 2.20 time: 0.031836 Jul 25 12:46:45.709006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 352/698] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:45 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:46:45.714301 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-76c42ef1-6142-4cd6-a990-3637d2e20ed0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '.version_select at 0x7f4c2d547af0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.719803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:45.721272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:45.739774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-76c42ef1-6142-4cd6-a990-3637d2e20ed0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136380267" status: 204 len: 0 microversion: 2.20 time: 0.029271 Jul 25 12:46:45.740384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 347/699] 10.222.0.60 () {60 vars in 1262 bytes} [Mon Jul 25 12:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136380267 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:46:45.864718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:45.865268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:45.872806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.873276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:45.874186 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:45.874614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:46.023261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:46.030750 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3ef6cb1e-ad2e-4298-9733-023265774dc1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.169998 Jul 25 12:46:46.031574 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 353/700] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:45 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:46.400620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-28ce2042-b001-4909-89e3-759415e5a0ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: .version_select at 0x7f4c2d4f9f70>, body: {"keypair": {"name": "tempest-keypair-408830358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEL3OfF6qSpGXPivPcwJlG2cePZLIf0hDG0Q8iMMCRE1s8reE5VsYEki4JxSSyuOCL9EWWecq64MeVawUK6q1mamTkbXwwaim7qzK2bm72feB8wEbpns9GfiPhxp2Vxvg=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:46.416385 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-28ce2042-b001-4909-89e3-759415e5a0ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for project df3ed3c23dde49b382ce9016e421e4de. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:46.420274 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-28ce2042-b001-4909-89e3-759415e5a0ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for user 1bc5799ac34349518854829ec2c259f9 and project df3ed3c23dde49b382ce9016e421e4de. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:46.443618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-28ce2042-b001-4909-89e3-759415e5a0ee tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046917 Jul 25 12:46:46.444214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 348/701] 10.222.0.60 () {62 vars in 1200 bytes} [Mon Jul 25 12:46:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 12:46:47.053372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:47.054853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:47.063546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:47.064264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:47.065251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:47.066062 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:47.223894 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:47.231687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-77f1f063-9c0b-442d-b648-2fdbcde118b4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.182782 Jul 25 12:46:47.232532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 354/702] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:47 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:48.253806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:48.254616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:48.263800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.264365 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.265580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.266341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.306187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-996419954", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bffa19eb-1fbf-4353-b2d6-9e8d3cb1c337"}], "security_groups": [{"name": "tempest-securitygroup--718853662"}], "key_name": "tempest-keypair-408830358", "user_data": "}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:48.421992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] validate_networks() for [('bffa19eb-1fbf-4353-b2d6-9e8d3cb1c337', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:46:48.430652 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:48.438148 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f32f83a4-1dfa-4159-924a-68ec84f504c6 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.189265 Jul 25 12:46:48.438715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 349/703] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:48 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:48.845263 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:46:48.845684 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:46:48.846188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:46:48.846595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:46:48.847003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:46:48.855768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.856166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.856957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:48.857385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:48.875135 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for project df3ed3c23dde49b382ce9016e421e4de. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:46:48.879035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Getting quotas for user 1bc5799ac34349518854829ec2c259f9 and project df3ed3c23dde49b382ce9016e421e4de. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:46:48.890573 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:46:48.892951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:46:48.939955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f67a81b2-846e-4cd4-9980-46124d8b0b73 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.637808 Jul 25 12:46:48.940602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 355/704] 10.222.0.60 () {62 vars in 1188 bytes} [Mon Jul 25 12:46:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 25 12:46:48.951917 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:48.952519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:49.033868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:49.041793 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:49.044865 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:49.046192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-35cab05d-67c5-45b2-a715-68501ae34072 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1280 microversion: 2.20 time: 0.098109 Jul 25 12:46:49.047554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 350/705] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:48 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:49.084113 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-776cca6a-5bad-4f19-91ac-a38a0f7f561b req-9b57ea62-836f-4eaa-866f-847ad35e47dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1988137c-976e-4521-b83a-c05377c0eeb7", "name": "network-vif-plugged", "status": "completed", "tag": "9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:49.096141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-776cca6a-5bad-4f19-91ac-a38a0f7f561b req-9b57ea62-836f-4eaa-866f-847ad35e47dc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.096591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-776cca6a-5bad-4f19-91ac-a38a0f7f561b req-9b57ea62-836f-4eaa-866f-847ad35e47dc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.108501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-776cca6a-5bad-4f19-91ac-a38a0f7f561b req-9b57ea62-836f-4eaa-866f-847ad35e47dc service nova] Creating event network-vif-plugged:9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b for instance 1988137c-976e-4521-b83a-c05377c0eeb7 on hv-cinder-82549 Jul 25 12:46:49.113750 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-776cca6a-5bad-4f19-91ac-a38a0f7f561b req-9b57ea62-836f-4eaa-866f-847ad35e47dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128776 Jul 25 12:46:49.114644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 356/706] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:49.460051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:49.460660 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:49.467155 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.467598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.468348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:49.468805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:49.598607 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:49.606716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1beaada8-c9b0-465d-afe1-0460d9df0ade tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.150542 Jul 25 12:46:49.607278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 351/707] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:49 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:50.072895 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.073582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.079840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.080285 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.081040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.081472 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.142177 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:50.150717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:50.152188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:50.153258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4f1b1e4a-e393-4642-9647-d93e610fb53a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1276 microversion: 2.20 time: 0.085597 Jul 25 12:46:50.153808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 357/708] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:50 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:50.627734 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:50.628348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:50.632369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:50.636455 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.636899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.637661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:50.638124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:50.769316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:50.776639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ef496dc7-2a04-4608-b6c7-f7efbf8b80da tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1365 microversion: 2.1 time: 0.152777 Jul 25 12:46:50.777205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 352/709] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:50 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:51.175958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.177049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:51.180500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:51.184834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.185269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.186064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.186500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.251598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:51.259755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:51.261273 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:51.262417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b793664f-a1e1-49c9-8b08-a22b50ce22e4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1340 microversion: 2.20 time: 0.090507 Jul 25 12:46:51.262955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 358/710] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:51 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:51.797755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:51.798379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:51.805276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.805708 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:51.806489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:51.806917 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.016465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:52.024509 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f9c9fd3e-c928-4417-b9d3-16014ac52222 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1555 microversion: 2.1 time: 0.230591 Jul 25 12:46:52.025323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 353/711] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:46:51 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:46:52.044505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:52.045068 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:52.051837 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.052316 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.053076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.053502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.131289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b325b3f0-a979-4b42-bc9f-ab891657b3dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090696 Jul 25 12:46:52.131990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 359/712] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:46:52 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:52.285281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:52.285883 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:52.292322 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.292762 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.293526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:52.294156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:52.361285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:52.370515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:52.372014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:52.373110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-30a25044-706b-443d-988c-5c76d2c103ae tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1338 microversion: 2.20 time: 0.091754 Jul 25 12:46:52.373671 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 354/713] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:52 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1338 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:53.211299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-7dc9ee94-42e9-4246-8567-abc0c9ff32a7 req-72baf773-926a-4bbf-aa82-601c660183fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988137c-976e-4521-b83a-c05377c0eeb7", "tag": "9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:53.220170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-9abcde72-d885-491e-a96e-a697f3d62537 req-825b0476-8fcd-497e-8dc0-21bbbc5c41f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:46:53.232444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-7dc9ee94-42e9-4246-8567-abc0c9ff32a7 req-72baf773-926a-4bbf-aa82-601c660183fb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:53.233370 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-7dc9ee94-42e9-4246-8567-abc0c9ff32a7 req-72baf773-926a-4bbf-aa82-601c660183fb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:53.250506 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-7dc9ee94-42e9-4246-8567-abc0c9ff32a7 req-72baf773-926a-4bbf-aa82-601c660183fb service nova] Creating event network-changed:9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b for instance 1988137c-976e-4521-b83a-c05377c0eeb7 on hv-cinder-82549 Jul 25 12:46:53.254404 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-9abcde72-d885-491e-a96e-a697f3d62537 req-825b0476-8fcd-497e-8dc0-21bbbc5c41f4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:53.254999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-9abcde72-d885-491e-a96e-a697f3d62537 req-825b0476-8fcd-497e-8dc0-21bbbc5c41f4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:53.258579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-7dc9ee94-42e9-4246-8567-abc0c9ff32a7 req-72baf773-926a-4bbf-aa82-601c660183fb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114280 Jul 25 12:46:53.260005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 360/714] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:46:53.270424 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-9abcde72-d885-491e-a96e-a697f3d62537 req-825b0476-8fcd-497e-8dc0-21bbbc5c41f4 service nova] Creating event network-changed:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:46:53.278191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-9abcde72-d885-491e-a96e-a697f3d62537 req-825b0476-8fcd-497e-8dc0-21bbbc5c41f4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062032 Jul 25 12:46:53.279073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 355/715] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:46:53.396912 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:53.398218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:53.405885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:53.406384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:53.407202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:53.407639 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:53.580464 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:53.589021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:53.590612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:53.591991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3b973a16-9286-464c-a7e7-5c3890c81fe3 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.199759 Jul 25 12:46:53.592560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 361/716] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:53 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:54.615217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:54.615914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:54.623374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.623821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.624580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:54.625016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:54.757162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:54.765001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:54.766538 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:54.767634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-618361f2-a172-4dc1-82f3-846051a6b28d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.156641 Jul 25 12:46:54.768203 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 356/717] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:54 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:55.791609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:55.792195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:55.799018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.799461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.800213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:55.800639 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:55.934903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:55.943179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:55.944649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:55.946361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2363f405-8892-42f6-8b88-454124bfb6e1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.160228 Jul 25 12:46:55.946981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 362/718] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:55 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:56.970129 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:56.970784 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:56.976879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:56.977323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:56.978694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:56.979123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:57.201088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:57.209105 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:57.210732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:57.211923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-de1a0027-61ee-4eee-9710-73fa56fe076c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.246454 Jul 25 12:46:57.213059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 357/719] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:56 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:58.236733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:58.237340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:58.244560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:58.245001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:58.245763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:58.246227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:58.376183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:58.384034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:58.385542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:58.386705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8afb45b9-a553-499a-a5b2-27e4bb71b57a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.154724 Jul 25 12:46:58.387233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 363/720] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:58 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:46:59.409921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:46:59.410543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:46:59.413069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:46:59.418583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.419019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.419777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:46:59.420197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:46:59.550546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:59.559228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:59.560733 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:46:59.561843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c09ba003-19e1-445b-b565-f5e90d921c92 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.155884 Jul 25 12:46:59.562460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 358/721] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:46:59 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:00.584092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:00.584714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:00.586608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:00.587929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:00.594483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.594919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.595668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:00.596091 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:00.730586 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.744814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.746361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:00.747457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e990b640-fe45-446c-b2a6-7f8b6ab3c209 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.167274 Jul 25 12:47:00.748006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 364/722] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:00 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:01.080015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-fd8bf525-79c6-4aa0-b9b6-6aedac6c1aca req-5dd4a7b6-6f61-4f2e-af79-6bab09cbe594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "name": "network-vif-plugged", "status": "completed", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:01.091032 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-fd8bf525-79c6-4aa0-b9b6-6aedac6c1aca req-5dd4a7b6-6f61-4f2e-af79-6bab09cbe594 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:01.091537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-fd8bf525-79c6-4aa0-b9b6-6aedac6c1aca req-5dd4a7b6-6f61-4f2e-af79-6bab09cbe594 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:01.103874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-fd8bf525-79c6-4aa0-b9b6-6aedac6c1aca req-5dd4a7b6-6f61-4f2e-af79-6bab09cbe594 service nova] Creating event network-vif-plugged:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:47:01.109077 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-fd8bf525-79c6-4aa0-b9b6-6aedac6c1aca req-5dd4a7b6-6f61-4f2e-af79-6bab09cbe594 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Jul 25 12:47:01.109851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 359/723] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:01.771114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:01.771722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:01.778817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:01.779261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:01.780026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:01.780460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:01.935453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.944756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.946300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:01.947929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-44cdd147-6bc9-44ed-be08-4b3fc01dcc00 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.180705 Jul 25 12:47:01.948494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 365/724] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:01 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:02.972617 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:02.973260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:02.980096 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:02.980535 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:02.981293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:02.981738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:03.112561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.120423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.121935 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:03.123035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ed5c661a-3061-4772-ad70-265f1ee33b8e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1405 microversion: 2.20 time: 0.155449 Jul 25 12:47:03.123592 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 360/725] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:02 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:04.094758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-300315685"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:04.095372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:04.101902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.102390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.103688 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.104123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.108256 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:04.145967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:04.146685 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:04.153639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.154245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.155055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.155486 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.278089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.network.security_group_api [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Removing security group b667ca07-8f57-4c71-acf8-a651c23796fd from port 70c70048-0571-4440-8eed-920a0694232f Jul 25 12:47:04.301690 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.309976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.311469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:04.312622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-efe1744d-ea22-43e1-b46a-e9c742c7c026 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1597 microversion: 2.20 time: 0.170968 Jul 25 12:47:04.313179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 361/726] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:47:04 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:47:04.335599 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:04.336083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:04.342795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.343242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.344001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.344432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.437444 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c7d1da2b-9026-45e1-bdd5-d5f19c685333 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105622 Jul 25 12:47:04.438069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 362/727] 10.222.0.60 () {60 vars in 1316 bytes} [Mon Jul 25 12:47:04 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:47:04.644729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0032af4f-c675-4659-9e3f-57773d23d6b0 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action" status: 202 len: 0 microversion: 2.1 time: 0.553905 Jul 25 12:47:04.645770 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 366/728] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:47:04 2022] POST /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:04.662855 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-c6c4ce0d-4da6-48ad-b8fb-e85a139725f9 req-668cdc75-b413-485e-bd85-4e597dc28f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:04.680711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-c6c4ce0d-4da6-48ad-b8fb-e85a139725f9 req-668cdc75-b413-485e-bd85-4e597dc28f20 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:04.680711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-c6c4ce0d-4da6-48ad-b8fb-e85a139725f9 req-668cdc75-b413-485e-bd85-4e597dc28f20 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:04.709066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-c6c4ce0d-4da6-48ad-b8fb-e85a139725f9 req-668cdc75-b413-485e-bd85-4e597dc28f20 service nova] Creating event network-changed:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:47:04.722537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-c6c4ce0d-4da6-48ad-b8fb-e85a139725f9 req-668cdc75-b413-485e-bd85-4e597dc28f20 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067989 Jul 25 12:47:04.725996 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 363/729] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.128593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.129141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:06.137876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.138357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.139133 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.139889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.158665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-074cb260-fb27-4e7f-8fa4-b743d5bbdd06 req-164fa922-322f-46e2-98e9-48bd0e381013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:06.170878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-074cb260-fb27-4e7f-8fa4-b743d5bbdd06 req-164fa922-322f-46e2-98e9-48bd0e381013 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.171549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-074cb260-fb27-4e7f-8fa4-b743d5bbdd06 req-164fa922-322f-46e2-98e9-48bd0e381013 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.185118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-074cb260-fb27-4e7f-8fa4-b743d5bbdd06 req-164fa922-322f-46e2-98e9-48bd0e381013 service nova] Creating event network-changed:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:47:06.192726 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-074cb260-fb27-4e7f-8fa4-b743d5bbdd06 req-164fa922-322f-46e2-98e9-48bd0e381013 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037928 Jul 25 12:47:06.193341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 364/730] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.249075 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lazy-loading 'services' on Instance uuid a61cc982-35c2-42e1-8da3-cdd742e6ae4d {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:06.348441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f2e8d8e7-cc82-4c66-a1f1-470b8c7269e4 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments/1c4113fc-827e-40cc-a68a-e664be515bfc" status: 202 len: 0 microversion: 2.1 time: 0.223570 Jul 25 12:47:06.353565 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 367/731] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:47:06 2022] DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments/1c4113fc-827e-40cc-a68a-e664be515bfc => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:06.359881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:06.362305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:06.379901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.381058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.383013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.383631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.430642 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=100 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:06.461772 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-84fd28ea-5ae1-40a6-aad6-044e7bb82810 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107144 Jul 25 12:47:06.463317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 365/732] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:06 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:06.740069 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-81302760-b579-47d6-90ba-4d8a600bb0e9 req-8f68bac5-3df9-45b8-bf13-2122ab4e6431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:06.752176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-81302760-b579-47d6-90ba-4d8a600bb0e9 req-8f68bac5-3df9-45b8-bf13-2122ab4e6431 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:06.752552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-81302760-b579-47d6-90ba-4d8a600bb0e9 req-8f68bac5-3df9-45b8-bf13-2122ab4e6431 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:06.765553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-81302760-b579-47d6-90ba-4d8a600bb0e9 req-8f68bac5-3df9-45b8-bf13-2122ab4e6431 service nova] Creating event network-changed:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:47:06.770409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-81302760-b579-47d6-90ba-4d8a600bb0e9 req-8f68bac5-3df9-45b8-bf13-2122ab4e6431 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034289 Jul 25 12:47:06.771010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 368/733] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:07.475051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:07.478198 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:07.485765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.486360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.487437 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.488131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.522043 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-38e282df-1f2a-47ce-899c-68b463b03f7d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050753 Jul 25 12:47:07.533141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 366/734] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:07 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:07.541408 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:07.542242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:07.549630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.550133 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.550935 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:07.554293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:07.642751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] HTTP exception thrown: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d is not attached to volume 1c4113fc-827e-40cc-a68a-e664be515bfc Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Request method failure captured: Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments/1c4113fc-827e-40cc-a68a-e664be515bfc HTTP/1.1 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o-ugSSdOLzwy7w-ZyrHuasOzsPIhSGl7J3Dl0vuxB-DNV8zmdCTJQJuJRmtwqBwyHwGRtsGBgk2NYbBQW-2_5qM38eLLtxqOJ39gZ1NVFWosjOLv70YU2XjCXNxtWPCUqHsy0IUjIY2ySZ5X0wvLTg18mJHWXkAzGKiLh4ODpP98fY Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 8260111bf70a4afab166caf5a4881931 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:47:07.645192 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8260111bf70a4afab166caf5a4881931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8260111bf70a4afab166caf5a4881931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8260111bf70a4afab166caf5a4881931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8260111bf70a4afab166caf5a4881931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 8260111bf70a4afab166caf5a4881931 Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestMinimumBasicScenario-233921546-project Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: f5032f6d4f074cae838066344fcea598 Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestMinimumBasicScenario-233921546-project Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:47:07.646927 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d is not attached to volume 1c4113fc-827e-40cc-a68a-e664be515bfc Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'server_id': 'a61cc982-35c2-42e1-8da3-cdd742e6ae4d', 'id': '1c4113fc-827e-40cc-a68a-e664be515bfc'} Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1c4113fc-827e-40cc-a68a-e664be515bfc. Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:07.647777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d is not attached to volume 1c4113fc-827e-40cc-a68a-e664be515bfc Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d is not attached to volume 1c4113fc-827e-40cc-a68a-e664be515bfc Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:07.649221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Returning 404 to user: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d is not attached to volume 1c4113fc-827e-40cc-a68a-e664be515bfc {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:07.650389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a7fe2e6c-5069-4064-9f00-902f9efa66c7 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments/1c4113fc-827e-40cc-a68a-e664be515bfc" status: 404 len: 154 microversion: 2.1 time: 0.115191 Jul 25 12:47:07.650389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 369/735] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:47:07 2022] DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d/os-volume_attachments/1c4113fc-827e-40cc-a68a-e664be515bfc => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:08.803330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.803846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.810429 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.810867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.811620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.812042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.838571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:08.919821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-74f2d161-966c-4803-ab02-dcf38805930e tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 204 len: 0 microversion: 2.1 time: 0.119829 Jul 25 12:47:08.920511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 367/736] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:08 2022] DELETE /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:08.928907 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:08.929556 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:08.936592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.937046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:08.937813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:08.938275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.070363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:09.078626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c3d8970f-983b-41e8-81cf-d40aa5eb31d5 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1555 microversion: 2.1 time: 0.153566 Jul 25 12:47:09.079438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 370/737] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:08 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:09.776729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:09.777675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:09.783491 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.783940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.784707 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.785143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.867719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lazy-loading 'services' on Instance uuid 64f4b7b4-6156-4da3-a667-d2bd66332366 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:09.940178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-21d8d682-d84e-46d5-99b0-d077af85e8a4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments/ef09a114-a8ab-46ce-a437-d2b6e2cacb1e" status: 202 len: 0 microversion: 2.1 time: 0.168103 Jul 25 12:47:09.940800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 368/738] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:47:09 2022] DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments/ef09a114-a8ab-46ce-a437-d2b6e2cacb1e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:09.949418 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:09.951737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:09.958424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.958877 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.959652 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:09.960090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:09.992264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8941620e-e7c8-49b8-9799-c67d5ec215f2 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046773 Jul 25 12:47:09.992746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 371/739] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:09 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:10.099564 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:10.100252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:10.106988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.107424 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.108447 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:10.108868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:10.239357 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:10.247401 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-06f01358-f2d1-4b40-9fbf-b8f109222b41 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1555 microversion: 2.1 time: 0.151966 Jul 25 12:47:10.247885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 369/740] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:10 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:11.004930 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:11.007056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:11.014143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.014592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.015359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.015791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.044874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d926dfcc-7be5-456c-8420-57bd1d12f0c6 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Jul 25 12:47:11.045435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 372/741] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:10 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:11.270144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:11.270675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:11.277296 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.277741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.278552 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:11.278982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:11.410564 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:11.417867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-634b7b37-4ed2-4345-a8e5-97da804aa8ca tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1555 microversion: 2.1 time: 0.152129 Jul 25 12:47:11.418468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 370/742] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:11 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:12.004460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-0cb9bf06-f38f-4dac-9a43-491674723d4c req-e3e03305-20a8-46b6-99b8-2205b8feca3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61cc982-35c2-42e1-8da3-cdd742e6ae4d", "name": "network-vif-deleted", "tag": "70c70048-0571-4440-8eed-920a0694232f"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:12.016115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0cb9bf06-f38f-4dac-9a43-491674723d4c req-e3e03305-20a8-46b6-99b8-2205b8feca3f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.016797 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0cb9bf06-f38f-4dac-9a43-491674723d4c req-e3e03305-20a8-46b6-99b8-2205b8feca3f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.029795 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-0cb9bf06-f38f-4dac-9a43-491674723d4c req-e3e03305-20a8-46b6-99b8-2205b8feca3f service nova] Creating event network-vif-deleted:70c70048-0571-4440-8eed-920a0694232f for instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d on hv-cinder-82549 Jul 25 12:47:12.036221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-0cb9bf06-f38f-4dac-9a43-491674723d4c req-e3e03305-20a8-46b6-99b8-2205b8feca3f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035123 Jul 25 12:47:12.037109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 373/743] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:12.057289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:12.059597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:12.065905 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.066379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.067147 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.067577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.096958 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f276f452-1b3b-48d4-8fa7-d0a5104de494 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044000 Jul 25 12:47:12.097443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 371/744] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:47:12 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:47:12.184033 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:12.185739 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:12.191548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.192178 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.192962 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.193397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.219117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:12.294965 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e9cd784e-9e78-49f1-9df1-5a6354bb21ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 204 len: 0 microversion: 2.1 time: 0.116716 Jul 25 12:47:12.295556 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 374/745] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:12 2022] DELETE /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:12.303664 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:12.304270 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:12.311551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.311980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.312760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.313159 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.440633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:12.441536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:12.449427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.450001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.450985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.451467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.453329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:12.461540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-af7d20cc-3dea-4146-8fff-9bcc372880b7 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1688 microversion: 2.1 time: 0.161795 Jul 25 12:47:12.462168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 372/746] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:12 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:12.485259 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:12.485698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:12.486176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lazy-loading 'fault' on Instance uuid a61cc982-35c2-42e1-8da3-cdd742e6ae4d {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:12.528607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:12.535931 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6f998536-7ea9-4fbc-b2b4-e5d937f48106 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1349 microversion: 2.1 time: 0.100403 Jul 25 12:47:12.536508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 375/747] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:12 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:13.483547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:13.484097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:13.490827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:13.491267 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.492034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:13.492461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.558350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:13.559056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:13.565978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:13.566737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.567588 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:13.568099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.605672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:13.606263 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:13.606731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lazy-loading 'fault' on Instance uuid a61cc982-35c2-42e1-8da3-cdd742e6ae4d {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:13.638647 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:13.646650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a362ab7a-d92d-410e-8bb3-c7dcfe980ba4 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1688 microversion: 2.1 time: 0.167266 Jul 25 12:47:13.647374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 373/748] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:13 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:13.653952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:13.661759 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d25ec620-d084-4964-8dbd-d5c192ebfa81 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1349 microversion: 2.1 time: 0.108380 Jul 25 12:47:13.662388 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 376/749] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:13 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:14.668497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:14.669103 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:14.675809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.676252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.677036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.677463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.682873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:14.683612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:14.691585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.692034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.692814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.693250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.728132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:14.728572 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:14.729018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lazy-loading 'fault' on Instance uuid a61cc982-35c2-42e1-8da3-cdd742e6ae4d {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:47:14.769748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5032f6d4f074cae838066344fcea598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8260111bf70a4afab166caf5a4881931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:14.778140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bc484e9a-b408-494a-b323-c05fb212ccbc tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 200 len: 1349 microversion: 2.1 time: 0.099071 Jul 25 12:47:14.778735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 377/750] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:14 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:14.814185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:14.824180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9ad5f2d1-e1b4-4243-8a36-d4fe7f1e216f tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1688 microversion: 2.1 time: 0.159478 Jul 25 12:47:14.824769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 374/751] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:14 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:15.799971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:15.800917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] [instance: a61cc982-35c2-42e1-8da3-cdd742e6ae4d] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:15.809642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.810591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.811627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.812226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.827444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] HTTP exception thrown: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Request method failure captured: Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d HTTP/1.1 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o-ugSSdOLzwy7w-ZyrHuasOzsPIhSGl7J3Dl0vuxB-DNV8zmdCTJQJuJRmtwqBwyHwGRtsGBgk2NYbBQW-2_5qM38eLLtxqOJ39gZ1NVFWosjOLv70YU2XjCXNxtWPCUqHsy0IUjIY2ySZ5X0wvLTg18mJHWXkAzGKiLh4ODpP98fY Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 8260111bf70a4afab166caf5a4881931 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:47:15.829425 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8260111bf70a4afab166caf5a4881931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8260111bf70a4afab166caf5a4881931"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8260111bf70a4afab166caf5a4881931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8260111bf70a4afab166caf5a4881931"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 8260111bf70a4afab166caf5a4881931 Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestMinimumBasicScenario-233921546 Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestMinimumBasicScenario-233921546-project Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: f5032f6d4f074cae838066344fcea598 Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestMinimumBasicScenario-233921546-project Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. Jul 25 12:47:15.832065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'a61cc982-35c2-42e1-8da3-cdd742e6ae4d'} Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:15.833120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. Jul 25 12:47:15.834805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:15.836443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Returning 404 to user: Instance a61cc982-35c2-42e1-8da3-cdd742e6ae4d could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:15.836443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-efa720e6-488b-4e9e-ba03-eb3e3a9e7ca2 tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d" status: 404 len: 111 microversion: 2.1 time: 0.036076 Jul 25 12:47:15.836443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 378/752] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:15 2022] GET /compute/v2.1/servers/a61cc982-35c2-42e1-8da3-cdd742e6ae4d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:15.841163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ffe0e9fa-09c9-4a47-ad63-ef7286c94e8d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] Calling method '.version_select at 0x7f4c2d4f9280>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:15.847128 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:15.847684 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:15.855702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.856219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.857142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:15.857832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:15.860810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ffe0e9fa-09c9-4a47-ad63-ef7286c94e8d tempest-TestMinimumBasicScenario-233921546 tempest-TestMinimumBasicScenario-233921546-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1019509300" status: 202 len: 0 microversion: 2.1 time: 0.024600 Jul 25 12:47:15.861583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 375/753] 10.222.0.60 () {58 vars in 1272 bytes} [Mon Jul 25 12:47:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1019509300 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:47:16.001219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:16.009897 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-645a5405-4bac-49fb-a8fc-c674b83f70cb tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1688 microversion: 2.1 time: 0.168006 Jul 25 12:47:16.010579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 379/754] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:15 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:17.034642 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:17.035253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:17.042725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:17.043179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:17.043966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:17.044398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:17.431825 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:17.440283 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-12e93d57-acb8-46ae-babf-c5791d7daccd tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1688 microversion: 2.1 time: 0.409900 Jul 25 12:47:17.440860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 376/755] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:17 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1688 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:18.455912 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-c30ed3fd-2409-49e8-9c4f-f16eed4d3576 req-46bb1049-f05b-4231-b555-18236ba2289a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f4b7b4-6156-4da3-a667-d2bd66332366", "name": "network-vif-deleted", "tag": "6b28587e-6996-4619-ba6a-9d6da94f0def"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:18.463851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:18.464579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:18.488997 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.490209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.491555 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.492285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.498859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-c30ed3fd-2409-49e8-9c4f-f16eed4d3576 req-46bb1049-f05b-4231-b555-18236ba2289a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:18.503492 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-c30ed3fd-2409-49e8-9c4f-f16eed4d3576 req-46bb1049-f05b-4231-b555-18236ba2289a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:18.545320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-c30ed3fd-2409-49e8-9c4f-f16eed4d3576 req-46bb1049-f05b-4231-b555-18236ba2289a service nova] Creating event network-vif-deleted:6b28587e-6996-4619-ba6a-9d6da94f0def for instance 64f4b7b4-6156-4da3-a667-d2bd66332366 on hv-cinder-82549 Jul 25 12:47:18.577002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-c30ed3fd-2409-49e8-9c4f-f16eed4d3576 req-46bb1049-f05b-4231-b555-18236ba2289a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125287 Jul 25 12:47:18.578240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 380/756] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:18.675857 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:18.686573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-71a4e57f-9d8e-42c1-b7b4-ff3f781eca24 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 200 len: 1329 microversion: 2.1 time: 0.226839 Jul 25 12:47:18.686809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 377/757] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:18 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 1329 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:19.713375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:19.714905 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 64f4b7b4-6156-4da3-a667-d2bd66332366] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:19.722005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:19.722801 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:19.723948 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:19.724778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:19.742495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] HTTP exception thrown: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Request method failure captured: Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 HTTP/1.1 Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8EmIKYVgzQNF9TKVx9CaU6EWQ9y_NXh7bqWeTEpX86Zj-l1LZHIAB537TxjOMD1kS8BKaoM-y0h1BR7YQeZvIYghVXBTComBdqNksuv2OU6X3Dv4ZngkRBOXNAPKBDSUM_JlFtoFHt0Lg8pBZmGmmkJ8yFs8crUHtCVth7L421EUY Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:47:19.744713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b0ca10639aa47dea81db9799273acba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: e56531920fc548a3a37f63ca0d1e5d82 Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. Jul 25 12:47:19.746287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '64f4b7b4-6156-4da3-a667-d2bd66332366'} Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:19.747007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. Jul 25 12:47:19.748141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:19.750445 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Returning 404 to user: Instance 64f4b7b4-6156-4da3-a667-d2bd66332366 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:19.751709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a533108b-ed2e-4b0c-b2f8-e34792699c07 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366" status: 404 len: 111 microversion: 2.1 time: 0.043497 Jul 25 12:47:19.754247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 381/758] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:19 2022] GET /compute/v2.1/servers/64f4b7b4-6156-4da3-a667-d2bd66332366 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:47:19.761705 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bc133495-0791-4962-a185-2e9be2c03919 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '.version_select at 0x7f4c2d627f70>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:19.791146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bc133495-0791-4962-a185-2e9be2c03919 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278752416" status: 202 len: 0 microversion: 2.1 time: 0.034131 Jul 25 12:47:19.795252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 378/759] 10.222.0.60 () {58 vars in 1218 bytes} [Mon Jul 25 12:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278752416 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:47:23.302502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:23.303065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:23.306042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:23.311435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.312001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.312868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.313377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.343748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:23.359957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:23.424774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6613006d-d2b6-41e5-a17a-a8256080d3fc tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 204 len: 0 microversion: 2.1 time: 0.125890 Jul 25 12:47:23.428727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 382/760] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:23 2022] DELETE /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:23.435448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:23.436120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:23.438339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:23.445888 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.446515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.447441 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:23.447943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:23.619082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:23.627069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a279d409-84ae-424d-923b-957c3e8fda6c tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1506 microversion: 2.1 time: 0.197045 Jul 25 12:47:23.627640 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 379/761] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:23 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:24.650320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:24.651977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:24.665107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.665562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.666389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.667000 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.885879 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:24.886108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-17a2a546-cfcf-4df9-8a85-a01ddec8164c req-9aaef88a-06c3-4a63-a4f1-cda8b079d0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4821016c-e408-4c18-9334-8b5e11aa18d2", "name": "network-vif-deleted", "tag": "c82f357c-9290-4145-9b37-868045fadfa7"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:24.898211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e25820eb-ee93-4790-b892-755fcb1714ce tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 200 len: 1506 microversion: 2.1 time: 0.253033 Jul 25 12:47:24.904492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-17a2a546-cfcf-4df9-8a85-a01ddec8164c req-9aaef88a-06c3-4a63-a4f1-cda8b079d0d9 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:24.905303 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-17a2a546-cfcf-4df9-8a85-a01ddec8164c req-9aaef88a-06c3-4a63-a4f1-cda8b079d0d9 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:24.915787 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 383/762] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:24 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:24.921328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-17a2a546-cfcf-4df9-8a85-a01ddec8164c req-9aaef88a-06c3-4a63-a4f1-cda8b079d0d9 service nova] Creating event network-vif-deleted:c82f357c-9290-4145-9b37-868045fadfa7 for instance 4821016c-e408-4c18-9334-8b5e11aa18d2 on hv-cinder-82549 Jul 25 12:47:24.927085 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-17a2a546-cfcf-4df9-8a85-a01ddec8164c req-9aaef88a-06c3-4a63-a4f1-cda8b079d0d9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046626 Jul 25 12:47:24.929727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 380/763] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:25.920707 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:25.921405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 4821016c-e408-4c18-9334-8b5e11aa18d2] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:25.928358 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.928875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.929774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.930304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.944396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] HTTP exception thrown: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Request method failure captured: Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 HTTP/1.1 Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8EmIKYVgzQNF9TKVx9CaU6EWQ9y_NXh7bqWeTEpX86Zj-l1LZHIAB537TxjOMD1kS8BKaoM-y0h1BR7YQeZvIYghVXBTComBdqNksuv2OU6X3Dv4ZngkRBOXNAPKBDSUM_JlFtoFHt0Lg8pBZmGmmkJ8yFs8crUHtCVth7L421EUY Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:47:25.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b0ca10639aa47dea81db9799273acba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: e56531920fc548a3a37f63ca0d1e5d82 Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. Jul 25 12:47:25.948409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '4821016c-e408-4c18-9334-8b5e11aa18d2'} Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:25.949317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. Jul 25 12:47:25.950850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:47:25.952110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Returning 404 to user: Instance 4821016c-e408-4c18-9334-8b5e11aa18d2 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:25.952110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a271826a-93ab-422f-9bda-db859e085920 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2" status: 404 len: 111 microversion: 2.1 time: 0.031670 Jul 25 12:47:25.952110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 384/764] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:25 2022] GET /compute/v2.1/servers/4821016c-e408-4c18-9334-8b5e11aa18d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:25.958380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:25.958950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:25.966259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.966720 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.967475 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:25.967907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:25.993765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:47:26.008531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:26.073388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a1a851e8-ae61-4933-9469-e18bcf925624 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "DELETE /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 204 len: 0 microversion: 2.1 time: 0.119412 Jul 25 12:47:26.074002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 381/765] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:47:25 2022] DELETE /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:47:26.082534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:26.083145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:26.089778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:26.090253 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:26.091027 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:26.091478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:26.275589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:26.283153 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0dd15488-2aa5-4598-b039-f4728d17a0d5 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.204656 Jul 25 12:47:26.283721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 385/766] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:26 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:27.305211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:27.305902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:27.312657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.313113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.313929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.314357 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.524944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e56531920fc548a3a37f63ca0d1e5d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0ca10639aa47dea81db9799273acba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:27.532639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-df0930c1-d9ac-465a-9421-020ac87ab5ab tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 200 len: 1520 microversion: 2.1 time: 0.231642 Jul 25 12:47:27.533221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 382/767] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:27 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:27.634446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-d22a3192-fa2c-49b0-9de1-7426b9fc105e req-0983590e-3cb7-4926-80dc-0677e282d369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a2d814-e80f-4925-a7b9-079437015ea9", "name": "network-vif-deleted", "tag": "374c317a-9ec5-4783-a0a0-3e363e8ecbb6"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:27.645490 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d22a3192-fa2c-49b0-9de1-7426b9fc105e req-0983590e-3cb7-4926-80dc-0677e282d369 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:27.645971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-d22a3192-fa2c-49b0-9de1-7426b9fc105e req-0983590e-3cb7-4926-80dc-0677e282d369 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:27.658905 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-d22a3192-fa2c-49b0-9de1-7426b9fc105e req-0983590e-3cb7-4926-80dc-0677e282d369 service nova] Creating event network-vif-deleted:374c317a-9ec5-4783-a0a0-3e363e8ecbb6 for instance 21a2d814-e80f-4925-a7b9-079437015ea9 on hv-cinder-82549 Jul 25 12:47:27.664502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-d22a3192-fa2c-49b0-9de1-7426b9fc105e req-0983590e-3cb7-4926-80dc-0677e282d369 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Jul 25 12:47:27.665201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 386/768] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:28.553604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:28.554227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] [instance: 21a2d814-e80f-4925-a7b9-079437015ea9] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:28.560875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:28.561316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:28.562102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:28.562528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:28.576151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] HTTP exception thrown: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Request method failure captured: Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 HTTP/1.1 Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8EmIKYVgzQNF9TKVx9CaU6EWQ9y_NXh7bqWeTEpX86Zj-l1LZHIAB537TxjOMD1kS8BKaoM-y0h1BR7YQeZvIYghVXBTComBdqNksuv2OU6X3Dv4ZngkRBOXNAPKBDSUM_JlFtoFHt0Lg8pBZmGmmkJ8yFs8crUHtCVth7L421EUY Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:47:28.577778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_3b0ca10639aa47dea81db9799273acba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/3b0ca10639aa47dea81db9799273acba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 3b0ca10639aa47dea81db9799273acba Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1507662625 Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: e56531920fc548a3a37f63ca0d1e5d82 Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1507662625-project Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. Jul 25 12:47:28.579406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '21a2d814-e80f-4925-a7b9-079437015ea9'} Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:47:28.580280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. Jul 25 12:47:28.581732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:47:28.583048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] Returning 404 to user: Instance 21a2d814-e80f-4925-a7b9-079437015ea9 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:47:28.583048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e45437d7-9fd8-48ee-bb57-1eed04904f99 tempest-ServerRescueNegativeTestJSON-1507662625 tempest-ServerRescueNegativeTestJSON-1507662625-project] 10.222.0.60 "GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9" status: 404 len: 111 microversion: 2.1 time: 0.029520 Jul 25 12:47:28.583048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 383/769] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:28 2022] GET /compute/v2.1/servers/21a2d814-e80f-4925-a7b9-079437015ea9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:47:37.642952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:37.652181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:37.796508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-09b53c52-091f-451d-a542-dd605dd1fab3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: .version_select at 0x7f4c2d21bd30>, body: {"keypair": {"name": "tempest-keypair-1041915671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhzgzIKDQAn4rRbxIQjMWKB2kwA7+aX+E31eq6FvjYtGZfLvnx+BvRtGcX3Isez7gvZ+a6TjxkDrqeyT1GCUsr2XCG4fOgsNkH8cO7FPXufoSNJGPKtujvSP1AKXdEFpg=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:37.812688 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-09b53c52-091f-451d-a542-dd605dd1fab3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for project 47ad60e5634942149abd3837dc89a019. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:37.818552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-09b53c52-091f-451d-a542-dd605dd1fab3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for user 9a4b1f0404e74e0e9e53e25ad92dcfed and project 47ad60e5634942149abd3837dc89a019. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:37.846722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-09b53c52-091f-451d-a542-dd605dd1fab3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.247148 Jul 25 12:47:37.847573 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 387/770] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:47:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:47:39.376653 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-196796506", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6ac7a57-2196-497c-a362-e349cd689a47"}], "security_groups": [{"name": "tempest-securitygroup--1145235556"}], "key_name": "tempest-keypair-1041915671", "user_data": "}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:39.386853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:39.387957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:39.765446 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] validate_networks() for [('a6ac7a57-2196-497c-a362-e349cd689a47', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:47:40.182904 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:47:40.183330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:47:40.183852 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:47:40.184340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:47:40.184711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:47:40.195181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:40.195627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.196421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:40.196847 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:40.217488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for project 47ad60e5634942149abd3837dc89a019. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:47:40.221992 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for user 9a4b1f0404e74e0e9e53e25ad92dcfed and project 47ad60e5634942149abd3837dc89a019. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:47:40.234719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:47:40.237503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:47:40.286620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a228e926-5e30-4e1e-ad3f-42ba5811574e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.914315 Jul 25 12:47:40.287269 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 384/771] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:47:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:47:40.307241 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a42bee19-1e8f-4c70-8fca-abad6ab0aa38 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:40.319014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a42bee19-1e8f-4c70-8fca-abad6ab0aa38 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:40.394421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a42bee19-1e8f-4c70-8fca-abad6ab0aa38 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:40.404073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a42bee19-1e8f-4c70-8fca-abad6ab0aa38 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1237 microversion: 2.1 time: 0.101180 Jul 25 12:47:40.424955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 388/772] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:40 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1237 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:41.431010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:41.431781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:41.438946 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.439542 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.440413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:41.440955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:41.511519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:41.519645 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d0130d2e-cff8-4e70-85a8-e98c555b8886 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1289 microversion: 2.1 time: 0.093543 Jul 25 12:47:41.520142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 385/773] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:41 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:42.542264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:42.542955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:42.550012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.550593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.551469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:42.551959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:42.694044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:42.702116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7ad3116b-663d-40b7-b123-69cbd1c08576 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.164093 Jul 25 12:47:42.702888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 389/774] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:42 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:47:43.040078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-7154707c-49da-4f28-9205-c0dce865ad07 req-e7774db1-9831-407b-b5c6-86a771a39129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a64767-90c8-40a7-9019-4054dd86361e", "tag": "b9ef35c2-defa-4487-823c-a24a086924a2"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:43.053681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-7154707c-49da-4f28-9205-c0dce865ad07 req-e7774db1-9831-407b-b5c6-86a771a39129 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.054170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-7154707c-49da-4f28-9205-c0dce865ad07 req-e7774db1-9831-407b-b5c6-86a771a39129 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.076716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-7154707c-49da-4f28-9205-c0dce865ad07 req-e7774db1-9831-407b-b5c6-86a771a39129 service nova] Creating event network-changed:b9ef35c2-defa-4487-823c-a24a086924a2 for instance f1a64767-90c8-40a7-9019-4054dd86361e on hv-cinder-82549 Jul 25 12:47:43.081643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-7154707c-49da-4f28-9205-c0dce865ad07 req-e7774db1-9831-407b-b5c6-86a771a39129 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048754 Jul 25 12:47:43.082294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 386/775] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:43.724300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:43.724851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:43.732039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.732745 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.733500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:43.733955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:43.874719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:43.882835 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-98305720-0c2c-4f79-a56e-684e010c2544 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.161962 Jul 25 12:47:43.883556 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 390/776] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:43 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:44.905208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:44.905868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:44.912008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.912454 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:44.913204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:44.914158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:45.041721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:45.049008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-60178219-fd24-4810-bf46-7dd4dc91d73c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.148484 Jul 25 12:47:45.049572 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 387/777] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:44 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:46.071272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:46.072504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:46.079136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.079585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.080355 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:46.080794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:46.212059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:46.219494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-516d173c-98f6-4844-acb7-ddb7618ff7cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.152945 Jul 25 12:47:46.220060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 391/778] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:46 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:47.240478 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:47.241086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:47.247759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.248205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.248975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:47.249404 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:47.384245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:47.391853 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-651344ca-8ba8-43d9-926f-7276f967cd2d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.155162 Jul 25 12:47:47.392422 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 388/779] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:47 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:48.412627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:48.413149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:48.420204 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.420649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.421409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:48.421840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:48.555265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:48.563382 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ef6cd9ad-8a16-48be-b90a-a115e69c73dd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.154671 Jul 25 12:47:48.563951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 392/780] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:48 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:49.235775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-23d3260f-2bc6-41db-bfd4-58ed6ad5a1aa req-f04412d7-f998-4372-b4a5-01276fe6e111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a64767-90c8-40a7-9019-4054dd86361e", "name": "network-vif-plugged", "status": "completed", "tag": "b9ef35c2-defa-4487-823c-a24a086924a2"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:49.246079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-23d3260f-2bc6-41db-bfd4-58ed6ad5a1aa req-f04412d7-f998-4372-b4a5-01276fe6e111 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.246579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-23d3260f-2bc6-41db-bfd4-58ed6ad5a1aa req-f04412d7-f998-4372-b4a5-01276fe6e111 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.257554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-23d3260f-2bc6-41db-bfd4-58ed6ad5a1aa req-f04412d7-f998-4372-b4a5-01276fe6e111 service nova] Creating event network-vif-plugged:b9ef35c2-defa-4487-823c-a24a086924a2 for instance f1a64767-90c8-40a7-9019-4054dd86361e on hv-cinder-82549 Jul 25 12:47:49.262521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-23d3260f-2bc6-41db-bfd4-58ed6ad5a1aa req-f04412d7-f998-4372-b4a5-01276fe6e111 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030836 Jul 25 12:47:49.263275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 389/781] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:49.584644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:49.585246 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:49.592430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.592869 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.593730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:49.594851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:49.722395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:49.730608 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-91621cae-5a8d-4d9e-b463-480a6b63afec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.149885 Jul 25 12:47:49.731296 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 393/782] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:49 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:50.749585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:50.750764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:50.755072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:50.755951 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:50.763206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.763651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.764414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:50.764966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:50.895676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:50.903655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-87379761-56ed-4d90-84e5-8466acdfeee7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1363 microversion: 2.1 time: 0.155360 Jul 25 12:47:50.904232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 390/783] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:50 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:51.924875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:51.925502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:51.927507 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:51.933440 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.933876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:51.934685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:51.935109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.218143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:47:52.225422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8b165d68-77e4-43d7-9220-61b6dde4b4f5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1550 microversion: 2.1 time: 0.304339 Jul 25 12:47:52.225984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 394/784] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:47:51 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1550 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:47:52.246753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:47:52.247286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:47:52.253759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.254239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.254998 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:52.255429 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:52.332449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6bcd17ad-d1e6-4180-b83f-0713a65f1bed tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090159 Jul 25 12:47:52.333049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 391/785] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:47:52 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:47:53.245541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-389b2151-a12d-4d7e-bda7-b2eb730b7529 req-35ce989f-6959-4d94-bdd4-3d10d83541a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1a64767-90c8-40a7-9019-4054dd86361e", "tag": "b9ef35c2-defa-4487-823c-a24a086924a2"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:47:53.255450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-389b2151-a12d-4d7e-bda7-b2eb730b7529 req-35ce989f-6959-4d94-bdd4-3d10d83541a5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:47:53.255889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-389b2151-a12d-4d7e-bda7-b2eb730b7529 req-35ce989f-6959-4d94-bdd4-3d10d83541a5 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:47:53.267996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-389b2151-a12d-4d7e-bda7-b2eb730b7529 req-35ce989f-6959-4d94-bdd4-3d10d83541a5 service nova] Creating event network-changed:b9ef35c2-defa-4487-823c-a24a086924a2 for instance f1a64767-90c8-40a7-9019-4054dd86361e on hv-cinder-82549 Jul 25 12:47:53.273501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-389b2151-a12d-4d7e-bda7-b2eb730b7529 req-35ce989f-6959-4d94-bdd4-3d10d83541a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031953 Jul 25 12:47:53.274155 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 395/786] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:22.882557 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:22.883736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=34 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:22.888097 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:22.888620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:22.895744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.896188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.896940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:22.897375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:22.921114 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0d7cba40-79ad-438b-8128-559396078415 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/ips" status: 200 len: 150 microversion: 2.1 time: 0.040011 Jul 25 12:48:22.921669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 392/787] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:48:22 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:24.250499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:24.251227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=38 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:24.255551 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:24.258577 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:24.265776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.266239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.266994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:24.267421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:24.528636 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-71e5391f-3a3f-4443-8eb2-3d9364f80ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279498 Jul 25 12:48:24.529468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 396/788] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:48:24 2022] POST /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:32.048220 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:32.050546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:32.056871 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.057314 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.058104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.058536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.135930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: POST /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments HTTP/1.1 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 74 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:48:32.137651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {"volumeAttachment": {"volumeId": "4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67"}} Jul 25 12:48:32.139445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'server_id': '1988137c-976e-4521-b83a-c05377c0eeb7', 'body': {'volumeAttachment': {'volumeId': '4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67'}}} Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:32.140367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:32.141848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 400 to user: Invalid volume: volume 4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 is already attached to instances: 1988137c-976e-4521-b83a-c05377c0eeb7 {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-039a5623-cd73-48e2-b94b-c363ec5ceadf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094819 Jul 25 12:48:32.143409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 393/789] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:48:32 2022] POST /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:48:32.203212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.203785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:32.210361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.210831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.211660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.212086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.289951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'services' on Instance uuid 1988137c-976e-4521-b83a-c05377c0eeb7 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:32.361107 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-66c507c5-67cb-4d1d-93c7-ced5ec25fef9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments/4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67" status: 202 len: 0 microversion: 2.1 time: 0.161890 Jul 25 12:48:32.361669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 397/790] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:48:32 2022] DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments/4e9fc7b3-1ea8-473b-82f6-6dc0eedb9f67 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:48:32.370715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:32.372959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:32.379104 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.379546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.380314 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:32.380741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:32.413342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e5521eef-4a86-426b-ac1c-0c32b495ea9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047280 Jul 25 12:48:32.413901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 394/791] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:48:32 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:33.426674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.429021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.437312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.437761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.438557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.439004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.467066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-04ec17c4-b52d-4ef5-abb0-f90b8a75502d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045192 Jul 25 12:48:33.467632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 398/792] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:48:33 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:48:33.528443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.528963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.535614 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.536057 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.536813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.537244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.562358 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:48:33.637514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4877bd2b-f169-4e43-bf65-f494566599d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 204 len: 0 microversion: 2.1 time: 0.112561 Jul 25 12:48:33.638175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 395/793] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:48:33 2022] DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 12:48:33.647110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:33.647727 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:33.654390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.654840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.655603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:33.656037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:33.788109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:33.796299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8ef89b55-b3c2-434e-b910-036b044237d1 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1680 microversion: 2.1 time: 0.153247 Jul 25 12:48:33.796863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 399/794] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:33 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:34.817111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:34.817825 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:34.824269 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.824736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.825477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:34.825900 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:34.957380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:34.964807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a4cee264-0736-41ce-8cbe-a07cda1df275 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1680 microversion: 2.1 time: 0.151850 Jul 25 12:48:34.965374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 396/795] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:34 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:35.986392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:35.987026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:35.994187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.994637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:35.995405 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:35.995839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.067409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:36.068127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:36.076828 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.077278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.078130 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.078562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.103706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-68576181-605e-4673-81b8-e80f51d66697 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/ips" status: 200 len: 151 microversion: 2.20 time: 0.040191 Jul 25 12:48:36.104591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 397/796] 10.222.0.60 () {60 vars in 1289 bytes} [Mon Jul 25 12:48:36 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 12:48:36.135272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:36.143548 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cd91c899-f889-43e6-8491-ff5d8297cb57 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1680 microversion: 2.1 time: 0.161177 Jul 25 12:48:36.144395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 400/797] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:35 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:36.840910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-ac564ae4-d066-4837-a19d-4ee28aa9cfb7 req-354218b0-c76e-4b3b-acb9-7ad7f01ea8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1988137c-976e-4521-b83a-c05377c0eeb7", "name": "network-vif-deleted", "tag": "9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:36.859280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-ac564ae4-d066-4837-a19d-4ee28aa9cfb7 req-354218b0-c76e-4b3b-acb9-7ad7f01ea8ec service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:36.859719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-ac564ae4-d066-4837-a19d-4ee28aa9cfb7 req-354218b0-c76e-4b3b-acb9-7ad7f01ea8ec service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:36.882740 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-ac564ae4-d066-4837-a19d-4ee28aa9cfb7 req-354218b0-c76e-4b3b-acb9-7ad7f01ea8ec service nova] Creating event network-vif-deleted:9192a82f-7a3a-4c70-9a3d-02d55ffd5c5b for instance 1988137c-976e-4521-b83a-c05377c0eeb7 on hv-cinder-82549 Jul 25 12:48:36.889656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-ac564ae4-d066-4837-a19d-4ee28aa9cfb7 req-354218b0-c76e-4b3b-acb9-7ad7f01ea8ec service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052299 Jul 25 12:48:36.890303 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 398/798] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:37.166743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:37.167359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.177500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.178132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.178898 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.179724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.213234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.213676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.214145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'fault' on Instance uuid 1988137c-976e-4521-b83a-c05377c0eeb7 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:37.255448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:37.263627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-88b49875-1e5a-45f8-bf8f-f2468de40b36 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 200 len: 1329 microversion: 2.1 time: 0.101601 Jul 25 12:48:37.264180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 401/799] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:37 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:37.944091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:37.944678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:37.951117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.951591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.952332 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:37.952759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:37.976668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lazy-loading 'flavor' on Instance uuid 157eacfc-396b-4b94-9c7b-748a8509fbe0 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:48:38.180252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6778ce0e-985e-472c-a1f7-eb97d2deb9b0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/action" status: 202 len: 0 microversion: 2.20 time: 0.242443 Jul 25 12:48:38.180859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 399/800] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Jul 25 12:48:37 2022] POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:48:38.189004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:38.189605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:38.197299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.197717 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.198571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.199037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.287780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:38.289585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:38.298528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.298965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.299732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:38.300163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:38.315250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 HTTP/1.1 Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:48:38.317493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:48:38.319312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '1988137c-976e-4521-b83a-c05377c0eeb7'} Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:48:38.320160 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:48:38.321389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:48:38.322533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:48:38.322533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9b7b75dd-1121-4454-b701-e9831d054633 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 404 len: 111 microversion: 2.1 time: 0.037970 Jul 25 12:48:38.322533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 400/801] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:38 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:48:38.327575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fc301601-f18a-4dba-8d56-3c585cff0eb4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '.version_select at 0x7f4c2d4ac0d0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:38.339454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:38.346885 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fc301601-f18a-4dba-8d56-3c585cff0eb4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231426977" status: 202 len: 0 microversion: 2.1 time: 0.022882 Jul 25 12:48:38.347463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 401/802] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Jul 25 12:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231426977 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:48:38.350811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:38.350811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:38.352259 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-be62bd97-9dca-4006-ac4d-fec5d0792c75 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.167126 Jul 25 12:48:38.352820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 402/803] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:38 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:38.997821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c49708ba-03db-48a3-9b58-1231d8c7481f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: .version_select at 0x7f4c2d4b0550>, body: {"keypair": {"name": "tempest-keypair-1763868414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXyKLBxZzQOyRYyw7JvYt5Tmbzq7a83IFSTiym2bp9SIvp5HGxmkqbnncLuLrtab9vrkwC9TvfKxV/0AOQ+Y2UewNQsDepsX92BqJJP175a+fuWVgC4K0VfIf7Z+yVLEA=="}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:39.014449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-c49708ba-03db-48a3-9b58-1231d8c7481f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:39.018321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-c49708ba-03db-48a3-9b58-1231d8c7481f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'key_pairs'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:39.041625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c49708ba-03db-48a3-9b58-1231d8c7481f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048117 Jul 25 12:48:39.042476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 402/804] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:48:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:39.375130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:39.375758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:39.382336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:39.382763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:39.383538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:39.383974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:39.524335 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:39.532380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:39.533956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:39.535122 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2c3d772b-4cad-4ad5-b517-c18c59635037 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.164106 Jul 25 12:48:39.535981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 403/805] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:39 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:48:40.404005 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1121906963", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4181ae2d-cd73-4cb4-a9d0-f28fef05143a"}], "security_groups": [{"name": "tempest-securitygroup--620110374"}], "key_name": "tempest-keypair-1763868414", "user_data": "}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:40.509924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] validate_networks() for [('4181ae2d-cd73-4cb4-a9d0-f28fef05143a', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:48:40.559668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:40.560295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:40.567134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.567584 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.568367 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.568800 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.707783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:40.716281 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:40.717814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:40.719256 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-af92caa1-d875-4c3a-92c3-42cb68343f57 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.163501 Jul 25 12:48:40.719832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 404/806] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:40 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:40.901445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:48:40.902059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:48:40.902547 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:48:40.903102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:48:40.903560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:48:40.913205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.914185 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.915241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:40.915624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:40.933498 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:48:40.937633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Getting quotas for user 6f611c60491941ca8a0200212ab0c7a7 and project 49256bcb551a4f8680db9a73763c435e. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:48:40.948963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:48:40.951309 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:48:41.000392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8ddb1def-0467-4527-a48b-1ce8231000e3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601415 Jul 25 12:48:41.001055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 403/807] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:48:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:48:41.012412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e27cc889-90d9-47e5-b5bc-aa43e88c7c75 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:41.013041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e27cc889-90d9-47e5-b5bc-aa43e88c7c75 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:41.073180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e27cc889-90d9-47e5-b5bc-aa43e88c7c75 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.081824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e27cc889-90d9-47e5-b5bc-aa43e88c7c75 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1242 microversion: 2.1 time: 0.073345 Jul 25 12:48:41.082466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 405/808] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:41 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:41.743469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:41.744088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:41.750881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.751327 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.752084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:41.752507 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:41.895499 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.903385 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.904886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:41.906062 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-75e38ea1-c841-4d68-930f-1d31d8e22ee5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.167235 Jul 25 12:48:41.906619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 404/809] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:41 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:42.102430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:42.103041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:42.110533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.110980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:42.111753 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.112183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:42.182756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:42.190880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a3549422-4c79-4a05-847b-32bbbf7611cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1312 microversion: 2.1 time: 0.092252 Jul 25 12:48:42.191793 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 406/810] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:42 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:42.931224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:42.931851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:42.939500 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.939981 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:42.940978 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:42.941612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.157999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:43.168280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:43.170298 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:43.171831 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-07ec1bc5-0a32-4e76-a902-32c374632cb4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.245279 Jul 25 12:48:43.173987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 405/811] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:42 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:43.211971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:43.212582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:43.219723 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.220171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.220974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:43.221412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:43.372156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:43.380051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-df6c3f79-ed44-4bc4-8df1-fa4b8d8f320f tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.171831 Jul 25 12:48:43.380664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 407/812] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:43 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:44.087228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-36e1fb4f-38a4-4cd6-b96a-f7b524ee10db req-1ba613b2-b2a9-4216-84bd-5afeb5bd3ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abc9d4d-84f7-4384-b04b-00c9377cd2f3", "tag": "de55d0a4-7a8f-49d3-8bd7-26f9992047bb"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:44.099569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-36e1fb4f-38a4-4cd6-b96a-f7b524ee10db req-1ba613b2-b2a9-4216-84bd-5afeb5bd3ec2 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.100020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-36e1fb4f-38a4-4cd6-b96a-f7b524ee10db req-1ba613b2-b2a9-4216-84bd-5afeb5bd3ec2 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.126410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-36e1fb4f-38a4-4cd6-b96a-f7b524ee10db req-1ba613b2-b2a9-4216-84bd-5afeb5bd3ec2 service nova] Creating event network-changed:de55d0a4-7a8f-49d3-8bd7-26f9992047bb for instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 on hv-cinder-82549 Jul 25 12:48:44.132180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-36e1fb4f-38a4-4cd6-b96a-f7b524ee10db req-1ba613b2-b2a9-4216-84bd-5afeb5bd3ec2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049958 Jul 25 12:48:44.133037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 406/813] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:44.196321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:44.197298 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:44.204318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.204766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.205554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.206014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.355470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:44.365558 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:44.367179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:44.368398 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a2073ca1-0d2c-4c83-8bd9-1aeb9613b063 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.176236 Jul 25 12:48:44.368956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 408/814] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:44 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:44.402861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:44.403658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:44.409975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.410508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.411304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:44.411743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:44.628673 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:44.637384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4b30f9bb-a13b-4ac3-85f9-2ef0df156c1d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.238629 Jul 25 12:48:44.642278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 407/815] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:44 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:45.392268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.392978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.399507 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.399880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.400632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.401086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.532168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:45.540837 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:45.542384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:45.543590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8798a27a-6c4f-45e4-bcdd-65df896352c8 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.155226 Jul 25 12:48:45.544150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 409/816] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:45 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:45.657989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:45.658596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:45.665554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.666019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.666780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:45.667205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:45.797284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:45.804892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-04daedd1-dd2a-4d3c-8f67-b1086e7755cf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.150844 Jul 25 12:48:45.805467 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 408/817] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:45 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:46.567956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:46.568591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:46.575789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.576237 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.576997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.577432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.707898 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.715891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.717400 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.718605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-03e49987-5d5c-468a-b8f8-128f9f3b0e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.154545 Jul 25 12:48:46.719165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 410/818] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:46 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:48:46.826049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:46.826600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:46.833036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.833482 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.834277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:46.834714 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:46.987753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:46.995899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-11b071c3-b747-41e7-8c46-47315446c2f8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.173871 Jul 25 12:48:46.996460 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 409/819] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:46 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:47.742118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:47.742668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:47.749319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.749761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.750585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:47.751017 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:47.755703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:47.905712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:47.914394 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:47.915980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:47.917307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-000cc656-16a4-4e6e-ad5c-834fd296d86c tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.179192 Jul 25 12:48:47.917875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 411/820] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:47 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:48.017125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:48.017661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:48.024181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.024631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.025396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.025842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.031329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:48.163354 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:48.171183 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7fda8c2c-ae5e-4e8d-a642-aafb4ee15fb0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.157957 Jul 25 12:48:48.171761 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 410/821] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:48 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:48.942861 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:48.943439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:48.950835 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.951282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:48.952038 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:48.952478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.082579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.091124 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.092626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.093778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2a1e2bdc-b55e-487f-8c33-5e44776f3c9e tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.155503 Jul 25 12:48:49.094366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 412/822] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:48 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:49.195884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:49.196782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:49.203989 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.204427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.205180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:49.205606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:49.337390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:49.344895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-25ff7713-484f-4307-8d40-bbd24b9722d2 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.156627 Jul 25 12:48:49.345462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 411/823] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:49 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:50.116121 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:50.117444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:50.124086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.124533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.125323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.125759 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.263756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.271834 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.273884 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.275072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6a6264ea-0243-4d4f-bc6f-04e51c4962ef tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.162920 Jul 25 12:48:50.275632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 413/824] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:50 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:50.366392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:50.366950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:50.373316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.373760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.374548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:50.374979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:50.502614 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:50.510681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-58353d6a-2657-468e-a276-185602cb6dbf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.148374 Jul 25 12:48:50.511250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 412/825] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:50 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:51.300624 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.301235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:51.303138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:51.310215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.310668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.311449 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.311889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.452056 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:51.460120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:51.462030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:51.462848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-773427d5-b993-4a10-87c6-e5229a805bce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.166120 Jul 25 12:48:51.463427 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 414/826] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:51.532066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:51.532748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:51.534967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:51.535619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=10 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:51.542768 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.543208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.543972 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.544394 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.684449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:51.685733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-49f0608e-264e-40d1-bf77-f42504ed3dbe req-bc96eaff-3f36-40a6-8d0f-9316b718f90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc9d4d-84f7-4384-b04b-00c9377cd2f3", "name": "network-vif-plugged", "status": "completed", "tag": "de55d0a4-7a8f-49d3-8bd7-26f9992047bb"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:51.695623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-49f0608e-264e-40d1-bf77-f42504ed3dbe req-bc96eaff-3f36-40a6-8d0f-9316b718f90e service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:51.696046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-49f0608e-264e-40d1-bf77-f42504ed3dbe req-bc96eaff-3f36-40a6-8d0f-9316b718f90e service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:51.697204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e0c2d7f2-6c3c-4912-8c39-6bcd2259efc9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.168906 Jul 25 12:48:51.698643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 413/827] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:51 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:51.715142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-49f0608e-264e-40d1-bf77-f42504ed3dbe req-bc96eaff-3f36-40a6-8d0f-9316b718f90e service nova] Creating event network-vif-plugged:de55d0a4-7a8f-49d3-8bd7-26f9992047bb for instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 on hv-cinder-82549 Jul 25 12:48:51.720373 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-49f0608e-264e-40d1-bf77-f42504ed3dbe req-bc96eaff-3f36-40a6-8d0f-9316b718f90e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038198 Jul 25 12:48:51.721213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 415/828] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:48:52.486722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:52.487245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:52.496896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:52.497342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:52.498144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:52.498601 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:52.624792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:52.633765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:52.635505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:52.636496 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fa3043bc-2c22-4aee-ab8a-2003e8e39a41 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.153757 Jul 25 12:48:52.637083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 414/829] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:52 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:52.721315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:52.722042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:52.728240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:52.728691 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:52.729451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:52.729889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:52.867424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:52.874997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c028ce74-4d2f-49fc-842e-37fff8020990 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.158334 Jul 25 12:48:52.875564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 416/830] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:52 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:53.659439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:53.660000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:53.662503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:53.668445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.668881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.669638 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.670100 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.736508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-30c2a5f4-0e72-4562-8adf-812d05794026 req-7d63a00a-683a-4aeb-b6fe-524d698c182a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "name": "network-vif-plugged", "status": "completed", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:53.746838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-30c2a5f4-0e72-4562-8adf-812d05794026 req-7d63a00a-683a-4aeb-b6fe-524d698c182a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.747282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-30c2a5f4-0e72-4562-8adf-812d05794026 req-7d63a00a-683a-4aeb-b6fe-524d698c182a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.758627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-30c2a5f4-0e72-4562-8adf-812d05794026 req-7d63a00a-683a-4aeb-b6fe-524d698c182a service nova] Creating event network-vif-plugged:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:48:53.763507 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-30c2a5f4-0e72-4562-8adf-812d05794026 req-7d63a00a-683a-4aeb-b6fe-524d698c182a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 Jul 25 12:48:53.764226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 417/831] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:53.804418 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:53.812258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:53.813760 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:53.814936 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e2df2904-1845-4520-8021-897cf2a1e713 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.159422 Jul 25 12:48:53.815511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 415/832] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:53 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:53.896737 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:53.897988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:53.904164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.904614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:53.905372 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:53.905804 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:54.035778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:54.043788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cdc13415-c182-4779-95d2-7113e3cc7ea3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1367 microversion: 2.1 time: 0.151221 Jul 25 12:48:54.044345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 418/833] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:53 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:54.838923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:54.839567 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:54.846033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:54.846469 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:54.847225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:54.847651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:54.985164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:54.993689 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:54.995209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:54.996349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-63aebd7c-210e-497b-a2b7-371ce21560d9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.162553 Jul 25 12:48:54.996902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 416/834] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:54 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:55.064913 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:55.065526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:55.068154 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=51 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:55.074127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.074645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.075351 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.075785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.208603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:55.216273 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-240d5ecd-55f9-4caa-ba4c-629932b70063 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1557 microversion: 2.1 time: 0.155375 Jul 25 12:48:55.216853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 419/835] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:48:55 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:48:55.237240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:55.237727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:55.244798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.245238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.246019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:55.246443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:55.327588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cd1ab3e3-4938-4537-a72d-89379d66a194 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094126 Jul 25 12:48:55.328192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 417/836] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:48:55 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:48:56.020482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:56.021160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:56.031279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:56.031872 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:56.033209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:56.033660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:56.177832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:56.187286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:56.188843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:56.190105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-407212ec-b72b-4c14-a5e2-408cb77e81ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.173730 Jul 25 12:48:56.190684 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 420/837] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:56 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:56.550658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-cf66bc95-2701-4737-9421-70d03f35e057 req-e5ae9eb3-ffeb-4378-8fc7-315bcb002148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7abc9d4d-84f7-4384-b04b-00c9377cd2f3", "tag": "de55d0a4-7a8f-49d3-8bd7-26f9992047bb"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:48:56.560763 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-cf66bc95-2701-4737-9421-70d03f35e057 req-e5ae9eb3-ffeb-4378-8fc7-315bcb002148 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:56.561197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-cf66bc95-2701-4737-9421-70d03f35e057 req-e5ae9eb3-ffeb-4378-8fc7-315bcb002148 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:56.572992 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-cf66bc95-2701-4737-9421-70d03f35e057 req-e5ae9eb3-ffeb-4378-8fc7-315bcb002148 service nova] Creating event network-changed:de55d0a4-7a8f-49d3-8bd7-26f9992047bb for instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 on hv-cinder-82549 Jul 25 12:48:56.578368 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-cf66bc95-2701-4737-9421-70d03f35e057 req-e5ae9eb3-ffeb-4378-8fc7-315bcb002148 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031708 Jul 25 12:48:56.579164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 418/838] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:48:57.214811 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:57.215566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:57.223094 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:57.223603 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.224681 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:57.226117 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:57.369274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:57.377664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:57.379247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:57.380453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c7f882e8-6efd-454c-b676-8a4220eb0950 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1742 microversion: 2.20 time: 0.170565 Jul 25 12:48:57.381033 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 421/839] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:57 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:58.408028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:58.409585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:58.417259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:58.417727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:58.418539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:58.418975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:58.593516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:58.608819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:58.610916 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:58.612403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ccf86535-6674-4a38-990a-9956401041aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.209158 Jul 25 12:48:58.613090 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 419/840] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:58 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:48:59.642968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:48:59.645014 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:48:59.656970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:59.657416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:59.658224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:48:59.658661 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:48:59.837580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:59.846981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:59.848677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:48:59.849872 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-98d481cf-f12a-4146-adda-5dfc15d0ac6b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.213802 Jul 25 12:48:59.854959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 422/841] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:48:59 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:00.879157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:00.880743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:00.890470 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.891301 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:00.892335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:00.893027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:01.059376 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:01.068326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:01.069878 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:01.071238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-26717095-8f49-4a5d-ba16-220a09c9460b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.199915 Jul 25 12:49:01.082596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 420/842] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:00 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:02.105156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:02.105971 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:02.113201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.113649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.114489 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:02.114925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:02.282138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:02.294500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:02.296805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:02.298755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-03018320-8dbf-4333-8972-4fe9cc92b27a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.201294 Jul 25 12:49:02.299902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 423/843] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:02 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:03.328641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:03.329443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:03.336942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.337609 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.338910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:03.339696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:03.497200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:03.505580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:03.507128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:03.508537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a5cfd7bc-ddd7-4d33-8681-80a1c9cfa651 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.184768 Jul 25 12:49:03.509102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 421/844] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:03 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:04.534908 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:04.536348 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:04.543880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.544350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:04.545191 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:04.545633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:04.722910 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:04.732815 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:04.734395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:04.735600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9eac84be-97fa-48b7-9000-7cbf2d1d5dd6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.204739 Jul 25 12:49:04.736611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 424/845] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:04 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:05.769854 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:05.771385 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:05.779169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.779665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.781884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:05.782416 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:05.959496 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:05.972955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:05.974845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:05.976783 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-be082863-a28d-4c36-9118-43ccbb854845 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.210768 Jul 25 12:49:05.977655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 422/846] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:05 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:07.001748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:07.002345 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:07.012495 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.012944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.013731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:07.014215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:07.201035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:07.209094 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:07.210649 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:07.211799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d2656f5a-4ecf-4f44-b183-1cbfc111c696 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.215015 Jul 25 12:49:07.212352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 425/847] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:06 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:08.236300 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:08.236884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:08.244132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:08.244659 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:08.245493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:08.246034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:08.387717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:08.396327 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:08.398775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:08.400335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2bd1839c-d377-4e1c-afbd-7ca3e16bb346 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.168383 Jul 25 12:49:08.401132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 423/848] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:08 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:09.426631 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:09.427222 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:09.436526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:09.436526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:09.436526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:09.436526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:09.612787 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:09.622035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:09.623528 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:09.624788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-85aa4349-388d-4c56-b285-3f88370405e6 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.202161 Jul 25 12:49:09.625533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 426/849] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:09 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:10.648887 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:10.649492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:10.656521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:10.656962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:10.657732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:10.658189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:10.806312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:10.814361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:10.815864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:10.817017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-48d31cfe-7678-47b3-9a75-2d47cff594ce tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1737 microversion: 2.20 time: 0.172090 Jul 25 12:49:10.817576 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 424/850] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:10 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:11.840670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:11.841503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:11.848543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.848992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:11.849806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:11.850263 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:12.012580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:12.020828 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:12.022380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:12.023568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-67e4c39c-d48d-4823-a2aa-7a50d03c435b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1719 microversion: 2.20 time: 0.186835 Jul 25 12:49:12.024126 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 427/851] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:11 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:13.047068 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:13.047678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:13.054542 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:13.054990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:13.055767 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:13.056208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:13.207369 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:13.216169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:13.217789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:13.218984 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-49107b7b-3687-454e-9d4f-3bbfc3d60508 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1719 microversion: 2.20 time: 0.175815 Jul 25 12:49:13.219546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 425/852] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:13 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:14.242395 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:14.243020 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:14.249591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.250078 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.250855 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.251283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.395550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.404992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.406526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:14.407702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fff0b0f7-49ec-4b03-8057-c09ab2d57e14 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1722 microversion: 2.20 time: 0.169282 Jul 25 12:49:14.408267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 428/853] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:14 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:14.432138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6625c4b3-1f98-40fd-b258-e2dd7e8d99a4"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:14.435343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:14.442046 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.442618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.443389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.443813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.634352 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:14.732281 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-43b9d1dd-e049-4ea7-8b11-6501324818de tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304858 Jul 25 12:49:14.732893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 426/854] 10.222.0.60 () {62 vars in 1364 bytes} [Mon Jul 25 12:49:14 2022] POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 12:49:14.862569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:14.863065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:14.869622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.870119 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.870891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:14.871326 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:14.875321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=100 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:15.130774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f28e88d2-5ba7-479d-a4e5-3c6fb1b8a4b4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments/6625c4b3-1f98-40fd-b258-e2dd7e8d99a4" status: 202 len: 0 microversion: 2.20 time: 0.272095 Jul 25 12:49:15.131980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 429/855] 10.222.0.60 () {60 vars in 1457 bytes} [Mon Jul 25 12:49:14 2022] DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments/6625c4b3-1f98-40fd-b258-e2dd7e8d99a4 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:15.194682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:15.195248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:15.201334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.201782 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.202586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.203028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.305603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3c0aa918-d9af-4dad-86db-9d504da43e36 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/action" status: 202 len: 0 microversion: 2.20 time: 0.115527 Jul 25 12:49:15.306425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 427/856] 10.222.0.60 () {62 vars in 1319 bytes} [Mon Jul 25 12:49:15 2022] POST /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:49:15.314347 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:15.315092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:15.322563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.323010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.323784 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.324221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.464816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:15.474339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:15.476638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:15.478061 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f8954010-d24e-4dd3-b581-62dfd38b51cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1670 microversion: 2.20 time: 0.167584 Jul 25 12:49:15.479004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 430/857] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:15 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:15.566398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-0a0a21e3-95e6-4e6b-ba8c-04fd8082bea7 req-2decb060-b78c-45e5-92fc-c94d18194b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "name": "network-vif-unplugged", "status": "completed", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:15.582658 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0a0a21e3-95e6-4e6b-ba8c-04fd8082bea7 req-2decb060-b78c-45e5-92fc-c94d18194b9d service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:15.583420 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0a0a21e3-95e6-4e6b-ba8c-04fd8082bea7 req-2decb060-b78c-45e5-92fc-c94d18194b9d service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:15.598321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.compute.server_external_events [req-0a0a21e3-95e6-4e6b-ba8c-04fd8082bea7 req-2decb060-b78c-45e5-92fc-c94d18194b9d service nova] Unable to find a host for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0. Dropping event network-vif-unplugged {{(pid=129816) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 12:49:15.604146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-0a0a21e3-95e6-4e6b-ba8c-04fd8082bea7 req-2decb060-b78c-45e5-92fc-c94d18194b9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038869 Jul 25 12:49:15.605091 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 428/858] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 12:49:16.502842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:16.503555 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:16.511300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.511791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.512575 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:16.513006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:16.658479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:16.668226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:16.669952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:16.670939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b10b5422-814d-4fe6-999a-5bfb11e8aefd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1672 microversion: 2.20 time: 0.172032 Jul 25 12:49:16.671506 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 431/859] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:16 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:17.695374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:17.695979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:17.702549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:17.702993 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:17.703762 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:17.704173 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:17.848227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:17.857817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:17.859603 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:17.861017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-270eedc5-527c-4a3a-b9bb-4cbcf042100a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.170236 Jul 25 12:49:17.862163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 429/860] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:17 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:18.884880 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:18.885481 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:18.892355 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:18.892820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:18.893763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:18.894400 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.049699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:19.059597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:19.061221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:19.062522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ba63faa2-dfed-4b27-a9ce-e4c187387dd4 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.181676 Jul 25 12:49:19.063356 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 432/861] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:18 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:19.944172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:19.944735 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:19.951355 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.951927 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.952809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:19.953325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:19.980194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3b4d0753-9ec5-43fd-a134-bf4955218a01 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/ips" status: 200 len: 146 microversion: 2.1 time: 0.039076 Jul 25 12:49:19.980194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 430/862] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:49:19 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:20.088488 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:20.089576 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:20.096064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:20.096516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:20.097289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:20.097729 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:20.242521 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:20.250428 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:20.251938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:20.253120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-742e35d1-0c73-4398-a6a2-1e79d6bced60 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.170116 Jul 25 12:49:20.253891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 433/863] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:20 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:21.277661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:21.278252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:21.297677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:21.298165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:21.298938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:21.299370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:21.442014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:21.450579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:21.452088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:21.453242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a08481c8-fdd7-42bb-a640-c5be5df65442 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.179695 Jul 25 12:49:21.453799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 431/864] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:21 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:22.132679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef45108-3117-4cba-b56c-b1cf557af66e"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:22.135134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:22.141454 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.141926 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.142708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.143138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.479299 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:22.480666 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:22.488072 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.488619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.489477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:22.490214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:22.638263 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:22.647008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:22.648562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:22.650015 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1daeab3b-0a02-4fc6-b7c6-35164b21808b tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.175209 Jul 25 12:49:22.662388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 432/865] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:22 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:23.673875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:23.674583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:23.681017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:23.681490 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:23.682302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:23.682719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:23.830436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:23.839511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:23.841046 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:23.842249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-719ac150-6f87-4186-b47f-213f801bbde0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.172235 Jul 25 12:49:23.843040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 433/866] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:23 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:24.868585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:24.869284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:24.871824 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=40 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:24.877245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:24.877775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:24.878628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:24.879203 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:25.026684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:25.034975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:25.036472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:25.038170 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c52545dc-da45-4ff4-8aa0-1f07acf5f4d2 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.174083 Jul 25 12:49:25.038728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 434/867] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:24 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:26.063193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:26.063859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:26.071061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:26.071541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:26.072325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:26.072764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:26.216891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:26.227451 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:26.229668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:26.231003 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-38ce6776-345e-435e-ba68-5232ab1ef143 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.171660 Jul 25 12:49:26.232143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 435/868] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:26 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:27.256140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:27.256903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:27.264228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.264786 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:27.265682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:27.266143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:27.408562 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:27.416677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:27.418188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:27.419375 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2f53005e-0d65-473b-907e-e05f0e862216 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.167987 Jul 25 12:49:27.419929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 436/869] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:27 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:28.442083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:28.442738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:28.449028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:28.449472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:28.450250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:28.450684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:28.579261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:28.587661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:28.589151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:28.590318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f4d67339-ace8-42cb-a9a5-350792fc76eb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.152209 Jul 25 12:49:28.590875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 437/870] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:28 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:29.613898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:29.614589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:29.621490 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:29.621960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:29.622716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:29.623139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:29.751829 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:29.759639 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:29.761120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:29.762276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4a7a917e-2f42-44b7-9ce9-24331f8f6545 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.152230 Jul 25 12:49:29.762833 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 438/871] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:29 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:30.784805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:30.785570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:30.792121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:30.792570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:30.793340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:30.793778 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:30.931231 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:30.939483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:30.940999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:30.942171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-732d53eb-3a07-4e5d-8bcb-511018442587 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.161235 Jul 25 12:49:30.942730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 439/872] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:30 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:31.965703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:31.966418 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:31.972836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:31.973282 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:31.974074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:31.974508 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:32.108656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:32.117896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:32.119398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:32.120536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9d6cf036-96d5-4318-b1ca-ad4155e37cb7 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.158783 Jul 25 12:49:32.121084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 440/873] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:31 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:32.139785 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=31 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:32.215181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:33.144123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:33.144725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:33.151743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:33.152182 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:33.152940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:33.153370 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:33.287040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:33.290330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:33.295248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:33.296956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:33.298171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6d957cb0-64f9-4330-a044-12a41490468d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.157867 Jul 25 12:49:33.298717 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 441/874] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:33 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:34.320679 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:34.321488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:34.329224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:34.329665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:34.330588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:34.331030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:34.405043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-57a58805-f3ee-4122-a8b9-4d525e642fdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.276392 Jul 25 12:49:34.410846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 434/875] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:49:22 2022] POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments => generated 194 bytes in 12278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:34.479824 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:34.489074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:34.490812 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:34.492128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e6a67c41-ddc3-4782-a70c-281ccbb51fbd tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.175275 Jul 25 12:49:34.492694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 442/876] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:34 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:35.516350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:35.517044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:35.523957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:35.524412 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:35.525300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:35.525735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:35.657613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:35.666520 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:35.668016 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:35.669193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6bbdfabd-18d0-4a3a-a1c8-68e51bfe51ff tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.157574 Jul 25 12:49:35.669755 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 435/877] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:35 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:36.692695 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:36.693304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:36.700051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:36.700497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:36.701261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:36.701696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:36.885236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:36.893153 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:36.894681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:36.895817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-39c5708f-a583-4445-848b-b594b90f7c2a tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.207055 Jul 25 12:49:36.896529 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 443/878] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:36 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:49:37.713891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-7ff168f1-1892-406a-a2e2-91c7f64705ae req-a322bba7-a210-4945-a5af-d3251ed8bf0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "name": "network-vif-plugged", "status": "completed", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:37.725000 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-7ff168f1-1892-406a-a2e2-91c7f64705ae req-a322bba7-a210-4945-a5af-d3251ed8bf0f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.725518 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-7ff168f1-1892-406a-a2e2-91c7f64705ae req-a322bba7-a210-4945-a5af-d3251ed8bf0f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.737552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-7ff168f1-1892-406a-a2e2-91c7f64705ae req-a322bba7-a210-4945-a5af-d3251ed8bf0f service nova] Creating event network-vif-plugged:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:49:37.742683 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-7ff168f1-1892-406a-a2e2-91c7f64705ae req-a322bba7-a210-4945-a5af-d3251ed8bf0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Jul 25 12:49:37.743605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 436/879] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:49:37.918796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:37.919339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:37.926178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.926620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:37.927392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:37.927812 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:38.099342 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:38.108147 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:38.109636 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:38.110851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8db1c6e5-897b-43a4-86c2-a3e2a11c8ebb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.195986 Jul 25 12:49:38.111413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 444/880] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:37 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:38.246096 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:49:38.246294 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:49:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:49:39.272354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:39.273219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:39.281984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:39.282439 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:39.283224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:39.283660 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:39.424534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:39.432664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:39.434190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:39.435353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-34fdcb2a-a4f1-405b-8bc0-a0d25eeb41e5 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.304827 Jul 25 12:49:39.435938 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 437/881] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:39 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:40.462196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:40.463118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:40.473149 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:40.473678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:40.474879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:40.475534 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:40.627243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:40.636722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:40.638257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:40.640230 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e851e975-2b9a-430b-a88f-9033a524f636 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1728 microversion: 2.20 time: 0.183533 Jul 25 12:49:40.640388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 445/882] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:40 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:41.663894 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:41.664502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:41.671990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.672203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.672823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.673264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:41.818077 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:41.827455 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:41.828960 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:41.830168 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a05c7de1-8999-4398-be57-ded835a202aa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1715 microversion: 2.20 time: 0.170709 Jul 25 12:49:41.831151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 438/883] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:49:41 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:49:41.949345 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b3ba2542-62eb-4b1b-a7cd-6fffb1b2240a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:41.956347 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3ba2542-62eb-4b1b-a7cd-6fffb1b2240a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:41.956801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3ba2542-62eb-4b1b-a7cd-6fffb1b2240a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:42.024791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b3ba2542-62eb-4b1b-a7cd-6fffb1b2240a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Going to try to stop instance {{(pid=129816) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:49:42.070449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b3ba2542-62eb-4b1b-a7cd-6fffb1b2240a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action" status: 202 len: 0 microversion: 2.1 time: 0.126788 Jul 25 12:49:42.074245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 446/884] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:41 2022] POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:42.079489 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:42.079968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:42.086702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:42.087179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:42.088182 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:42.088623 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:42.228657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:42.237148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-aa2957c9-a581-40b4-b2bf-dcab657c4754 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.161719 Jul 25 12:49:42.237735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 439/885] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:42 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:43.260393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:43.261103 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:43.267513 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:43.267957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:43.268729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:43.269154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:43.767132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:43.775712 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e52de5ad-54f1-487e-a594-c755f904a5af tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.521034 Jul 25 12:49:43.776290 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 447/886] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:43 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:44.797990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:44.798637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:44.806257 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:44.806708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:44.807496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:44.807930 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:44.946618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:44.955063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9a94c9ad-0413-46cb-a303-b596f2364526 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.160954 Jul 25 12:49:44.955648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 440/887] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:44 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:45.978324 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:45.978951 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:45.986065 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:45.986523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:45.987304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:45.987748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:46.128939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:46.137905 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0b534412-a53b-49ce-9f2f-001de17bf214 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.164964 Jul 25 12:49:46.138604 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 448/888] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:45 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:47.161008 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:47.161620 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:47.168985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.169437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.170265 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:47.170710 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:47.309075 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:47.317230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1cce7976-3c25-49d4-bedd-859d440db60f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.160307 Jul 25 12:49:47.317814 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 441/889] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:47 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:48.338814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:48.339410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:48.346514 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:48.346716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:48.347415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:48.347841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:48.488233 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:48.496559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b0656e8e-4385-4176-b9b6-3d7a93e6b2de tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.161497 Jul 25 12:49:48.497132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 449/890] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:48 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:49.520198 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:49.520774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:49.527392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:49.527831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:49.528605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:49.529031 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:49.674101 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:49.686595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b6e7fef7-a07b-4c5f-8381-8469dec5db3d tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.170438 Jul 25 12:49:49.690063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 442/891] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:49 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:50.713094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:50.713710 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:50.720054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.720495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.721264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:50.721696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:50.864673 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:50.873634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b0c083fb-3724-4a86-9404-c5f7809098bb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.165220 Jul 25 12:49:50.874272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 450/892] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:50 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:51.896156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:51.896763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:51.903951 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.904393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:51.905179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:51.905612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:52.049827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:52.060629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6ad581e0-f17c-4add-a092-11ecba3d02f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.166479 Jul 25 12:49:52.061211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 443/893] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:51 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:53.100583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:53.101425 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:53.109412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:53.110743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:53.110743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:53.111161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:53.260360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:53.268483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-96c2dce1-c8b1-43a0-9dd0-750ce8804908 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.180161 Jul 25 12:49:53.269068 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 451/894] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:53 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:54.290385 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:54.291007 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:54.298217 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.298679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.299482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:54.299920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:54.442397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:54.450925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e2019b3c-6e8f-48d2-89fa-b5cd510b6c0b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.164814 Jul 25 12:49:54.451510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 444/895] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:54 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:55.472686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:55.473279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:55.475899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=36 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:55.482225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:55.482675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:55.483448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:55.483876 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:55.620335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:55.628166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-71e8f8bc-7ea5-48c2-bcf6-bdef1e33f584 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.159309 Jul 25 12:49:55.628710 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 452/896] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:55 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:56.650500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:56.651262 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:56.665843 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.666333 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.667135 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:56.667569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:56.809129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:56.817164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-99f89412-729a-4338-936c-f4703a5e9778 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1724 microversion: 2.1 time: 0.170582 Jul 25 12:49:56.817746 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 445/897] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:56 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:57.838910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:57.839653 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:57.845941 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:57.846387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:57.847144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:57.847567 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:57.981196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:57.989371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-599795b8-a6e4-4cf1-a67e-1b2a65b03194 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1701 microversion: 2.1 time: 0.154339 Jul 25 12:49:57.989990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 453/898] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:57 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:58.010376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c0ed3d94-3bc2-4984-a988-90d8a37e3024 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:49:58.016866 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c0ed3d94-3bc2-4984-a988-90d8a37e3024 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.017307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c0ed3d94-3bc2-4984-a988-90d8a37e3024 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:58.077481 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c0ed3d94-3bc2-4984-a988-90d8a37e3024 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Going to try to start instance {{(pid=129815) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 12:49:58.121513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c0ed3d94-3bc2-4984-a988-90d8a37e3024 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action" status: 202 len: 0 microversion: 2.1 time: 0.114551 Jul 25 12:49:58.122068 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 446/899] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:49:58 2022] POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:49:58.130746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:58.131366 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:58.137652 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.138258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:58.139172 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:58.139607 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:58.309561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:58.318650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0661b10f-ecc1-4dbb-9e36-eab7ec93fbaa tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1710 microversion: 2.1 time: 0.191620 Jul 25 12:49:58.319294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 454/900] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:58 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1710 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:49:59.341549 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:49:59.342264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:49:59.348550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.349607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.350619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:49:59.351059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:49:59.495141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:49:59.509436 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4701f3ad-527a-4d06-9420-84dbdf2eff9b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1710 microversion: 2.1 time: 0.172138 Jul 25 12:49:59.510538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 447/901] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:49:59 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:00.532676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:00.533240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:00.539992 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:00.540427 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:00.541184 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:00.541611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:00.678038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:00.685884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-969652ab-faf3-4a44-8d86-7e6898f1f207 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1714 microversion: 2.1 time: 0.157120 Jul 25 12:50:00.686477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 455/902] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:00 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:23.719431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:23.720026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:23.722127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=26 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:23.722778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:23.728567 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:23.729095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:23.729773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:23.730229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:23.754966 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ac06f1d8-d63f-4393-bd39-91d536b35058 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/ips" status: 200 len: 149 microversion: 2.1 time: 0.039485 Jul 25 12:50:23.755546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 448/903] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:50:23 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:26.156640 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89c5cb53-5138-4f04-a330-d7e9f31e41e7"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:26.159073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:26.161098 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=7 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:26.161748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:26.167793 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:26.168236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:26.169008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:26.169438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:26.443645 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b6902a55-02a7-44af-a114-27214e1edabf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "POST /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290855 Jul 25 12:50:26.444260 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 456/904] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:50:26 2022] POST /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:34.091396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:34.091995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:34.094499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:34.095127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:34.101066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.101509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:34.102332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.103298 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:34.186962 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'services' on Instance uuid 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:50:34.260108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bbd6d221-1380-4f46-9c55-2bb52a21608b tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments/89c5cb53-5138-4f04-a330-d7e9f31e41e7" status: 202 len: 0 microversion: 2.1 time: 0.174365 Jul 25 12:50:34.260700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 449/905] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:50:34 2022] DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments/89c5cb53-5138-4f04-a330-d7e9f31e41e7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:50:34.270922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:34.273264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:34.281701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.282166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:34.283791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:34.284304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:34.318058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-dfea1a63-3f0e-46bf-8a6a-2e4f65b75891 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052517 Jul 25 12:50:34.318711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 457/906] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:50:34 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:35.331986 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:35.334289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:35.341196 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.341638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.342441 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.342875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.375314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-02e99db1-a5aa-4077-b9e2-48013d8c39c9 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048362 Jul 25 12:50:35.375877 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 450/907] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:50:35 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:50:35.444609 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:35.445167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:35.452193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.452634 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.453391 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.453822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.481089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:50:35.557965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6ee1ec0f-108b-4e42-82d6-d5567228624d tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 204 len: 0 microversion: 2.1 time: 0.116894 Jul 25 12:50:35.558786 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 458/908] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:35 2022] DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:50:35.567065 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:35.567676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:35.574543 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.575079 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.575864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:35.576375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:35.714235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:35.722102 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-76e32ee3-b32b-47d2-ac5f-c7ca706ebfb3 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1681 microversion: 2.1 time: 0.158747 Jul 25 12:50:35.722733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 451/909] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:35 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:36.744920 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:36.745616 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:36.752275 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:36.752722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:36.753536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:36.754013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:36.889044 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:36.896758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-24a9b415-5340-4518-88bf-001e6ed0da3a tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1681 microversion: 2.1 time: 0.155981 Jul 25 12:50:36.903302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 459/910] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:36 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:37.921053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:37.921697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:37.928279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:37.928728 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:37.929499 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:37.929956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:38.062801 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:38.070446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9b4e3f67-12d7-4f49-8836-e2fcb9451fcf tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1681 microversion: 2.1 time: 0.153166 Jul 25 12:50:38.072036 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 452/911] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:37 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:38.600087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-70fcff27-6018-4266-ba14-78e4c0e1ecce req-3f529f04-7d8a-4031-a909-f25d8af51209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7abc9d4d-84f7-4384-b04b-00c9377cd2f3", "name": "network-vif-deleted", "tag": "de55d0a4-7a8f-49d3-8bd7-26f9992047bb"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:38.612489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-70fcff27-6018-4266-ba14-78e4c0e1ecce req-3f529f04-7d8a-4031-a909-f25d8af51209 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:38.612932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-70fcff27-6018-4266-ba14-78e4c0e1ecce req-3f529f04-7d8a-4031-a909-f25d8af51209 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:38.627159 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-70fcff27-6018-4266-ba14-78e4c0e1ecce req-3f529f04-7d8a-4031-a909-f25d8af51209 service nova] Creating event network-vif-deleted:de55d0a4-7a8f-49d3-8bd7-26f9992047bb for instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 on hv-cinder-82549 Jul 25 12:50:38.633108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-70fcff27-6018-4266-ba14-78e4c0e1ecce req-3f529f04-7d8a-4031-a909-f25d8af51209 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Jul 25 12:50:38.634589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 460/912] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:39.096668 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:39.097264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:39.105212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:39.105982 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:39.107156 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:39.107695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:39.144509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:39.145291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:39.145996 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lazy-loading 'fault' on Instance uuid 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:50:39.192504 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f611c60491941ca8a0200212ab0c7a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49256bcb551a4f8680db9a73763c435e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:39.200559 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-833e3866-9c8d-4e80-b13d-ed0594ebd315 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 200 len: 1332 microversion: 2.1 time: 0.107711 Jul 25 12:50:39.201151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 453/913] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:39 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:50:40.223323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:40.224022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:40.230390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:40.230834 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:40.231610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:40.232311 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:40.246436 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 HTTP/1.1 Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:40.248071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:40.249682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '7abc9d4d-84f7-4384-b04b-00c9377cd2f3'} Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:40.250738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:40.252336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:40.253683 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:40.253683 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8e222e70-db7c-4e80-a720-741860f544cb tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 404 len: 111 microversion: 2.1 time: 0.030870 Jul 25 12:50:40.253683 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 461/914] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:40 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:40.258585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6954bd5f-ace6-456e-8eb1-73f21a649e9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '.version_select at 0x7f4c2d353040>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:40.278980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6954bd5f-ace6-456e-8eb1-73f21a649e9e tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763868414" status: 202 len: 0 microversion: 2.1 time: 0.024142 Jul 25 12:50:40.279566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 454/915] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Jul 25 12:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763868414 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:50:42.033577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:42.034131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:42.040635 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:42.041077 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:42.041842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:42.042412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:42.056764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 HTTP/1.1 Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:42.058335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.059903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '7abc9d4d-84f7-4384-b04b-00c9377cd2f3'} Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:42.060738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.062004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.063208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:42.063208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0d66e7b7-3534-4571-85f3-869947c184b8 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 25 12:50:42.063208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 462/916] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:42 2022] DELETE /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:50:42.069157 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:42.069795 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 7abc9d4d-84f7-4384-b04b-00c9377cd2f3] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:42.077161 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:42.077612 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:42.078466 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:42.078904 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:42.092672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 HTTP/1.1 Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:42.094357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.095902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '7abc9d4d-84f7-4384-b04b-00c9377cd2f3'} Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:42.096864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. Jul 25 12:50:42.098409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:42.099794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 7abc9d4d-84f7-4384-b04b-00c9377cd2f3 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:42.099794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-596cdd65-30c5-4eee-ad45-a22b67979246 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3" status: 404 len: 111 microversion: 2.1 time: 0.031123 Jul 25 12:50:42.099794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 455/917] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:42 2022] GET /compute/v2.1/servers/7abc9d4d-84f7-4384-b04b-00c9377cd2f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:43.244018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:43.244570 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:43.251016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.251471 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.252288 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.252721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.267162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 HTTP/1.1 Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:43.268703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.270257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '1988137c-976e-4521-b83a-c05377c0eeb7'} Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:43.271030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.272284 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.273595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:43.273595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b0bb18e8-751f-4358-9e9b-bda131b98ad5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 404 len: 111 microversion: 2.1 time: 0.030573 Jul 25 12:50:43.273595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 463/918] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:43 2022] DELETE /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:43.278627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:43.279233 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 1988137c-976e-4521-b83a-c05377c0eeb7] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:43.286182 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.286639 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.287429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.287874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.302149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 HTTP/1.1 Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:43.303783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.305380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '1988137c-976e-4521-b83a-c05377c0eeb7'} Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:43.307129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. Jul 25 12:50:43.308613 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.310076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 1988137c-976e-4521-b83a-c05377c0eeb7 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:43.310076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-82e721ff-5430-484e-a8e6-55521c2b79dc tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7" status: 404 len: 111 microversion: 2.1 time: 0.030382 Jul 25 12:50:43.310076 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 456/919] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:43 2022] GET /compute/v2.1/servers/1988137c-976e-4521-b83a-c05377c0eeb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:43.315539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:43.316035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:43.322803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.323242 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.324013 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.324442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.339018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e HTTP/1.1 Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:43.340568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.342029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '70a118fe-83de-487b-baf3-8942c875079e'} Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:43.342779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.344406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.346390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:43.346390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8a0d24a5-4981-469f-b74e-b958f82a66e4 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 404 len: 111 microversion: 2.1 time: 0.030453 Jul 25 12:50:43.346390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 464/920] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:43 2022] DELETE /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:43.351887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:43.352507 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: 70a118fe-83de-487b-baf3-8942c875079e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:43.361882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.362719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.363744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:43.364189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:43.382943 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e HTTP/1.1 Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:43.385145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.386763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '70a118fe-83de-487b-baf3-8942c875079e'} Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:43.387924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. Jul 25 12:50:43.389199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:43.390505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance 70a118fe-83de-487b-baf3-8942c875079e could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:43.390505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-992d008c-bfb3-4b88-a172-514703eee0c5 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e" status: 404 len: 111 microversion: 2.1 time: 0.038668 Jul 25 12:50:43.390505 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 457/921] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:43 2022] GET /compute/v2.1/servers/70a118fe-83de-487b-baf3-8942c875079e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:44.537076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:44.537633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:44.544677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:44.545120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:44.545889 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:44.546349 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:44.560665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 HTTP/1.1 Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:44.562239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.563771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'eb0e67fb-85b0-495f-82fa-816792a84b43'} Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:44.564648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.566086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.567483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:44.567483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-00fbd0d6-5914-4bf1-ad96-d3d158ddd507 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 404 len: 111 microversion: 2.1 time: 0.030365 Jul 25 12:50:44.567483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 465/922] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:50:44 2022] DELETE /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:44.572526 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:44.573137 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] [instance: eb0e67fb-85b0-495f-82fa-816792a84b43] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:44.579821 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:44.580274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:44.581049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:44.581479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:44.595129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] HTTP exception thrown: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Request method failure captured: Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 HTTP/1.1 Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8V8Zc2GZHtBDMjwyl-YSwnGXgFqS-qTTRo6YvRbvXcjJIhr7RKh_lKnMVuYw0Niukdw1fdzEgnBXFZasvlFKo86HkjCTGsrckPYWPXeSUzMTliHPnE3Kpz0MQEgythL0tnoVeqWnHun-GyzMR5JBzjZA5F2WW_tpV3MDcVeAsUWjI Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:44.596672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_49256bcb551a4f8680db9a73763c435e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/49256bcb551a4f8680db9a73763c435e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 49256bcb551a4f8680db9a73763c435e Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1037802722 Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 6f611c60491941ca8a0200212ab0c7a7 Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeNegativeTest-1037802722-project Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.598187 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'eb0e67fb-85b0-495f-82fa-816792a84b43'} Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:44.599569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. Jul 25 12:50:44.601041 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:44.602274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] Returning 404 to user: Instance eb0e67fb-85b0-495f-82fa-816792a84b43 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:44.602274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ea5a81aa-8322-48d8-ab65-2984cd7ff1d0 tempest-AttachVolumeNegativeTest-1037802722 tempest-AttachVolumeNegativeTest-1037802722-project] 10.222.0.60 "GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43" status: 404 len: 111 microversion: 2.1 time: 0.029617 Jul 25 12:50:44.602274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 458/923] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:50:44 2022] GET /compute/v2.1/servers/eb0e67fb-85b0-495f-82fa-816792a84b43 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:46.977344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:46.979527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:46.986662 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:46.987112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:46.987892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:46.988331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:47.023764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-16f7980a-2f31-403a-bb99-9bf555c44991 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050310 Jul 25 12:50:47.024228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 466/924] 10.222.0.60 () {60 vars in 1343 bytes} [Mon Jul 25 12:50:46 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:50:47.098749 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:47.099563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:47.106525 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:47.107252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:47.108754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:47.109195 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:47.143859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:50:47.236127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9f23b640-761b-40c4-8c39-34f365a830e9 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 204 len: 0 microversion: 2.20 time: 0.143366 Jul 25 12:50:47.238764 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 459/925] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Jul 25 12:50:47 2022] DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 12:50:47.248008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:47.248994 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:47.256770 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:47.257465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:47.258852 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:47.260696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:47.495082 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:47.504197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:47.505755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:47.506903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b3b3493a-43b3-40fd-8d79-256e0f8894bb tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.262896 Jul 25 12:50:47.507473 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 467/926] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:47 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:50:48.531440 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:48.532061 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:48.538816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:48.539264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:48.540808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:48.541258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:48.684262 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:48.694267 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:48.695760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:48.697527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cb9c7f0d-a205-4294-9a45-15f400ae7a68 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1721 microversion: 2.20 time: 0.170452 Jul 25 12:50:48.698415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 460/927] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:48 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 12:50:49.265675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6ec39624-41b1-449c-a474-0b0aadec1e85 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Action: 'create', calling method: .version_select at 0x7f4c2d39b670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-699566921"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:49.598832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6ec39624-41b1-449c-a474-0b0aadec1e85 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.457564 Jul 25 12:50:49.599401 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 468/928] 10.222.0.60 () {60 vars in 1155 bytes} [Mon Jul 25 12:50:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 12:50:49.613520 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b7d8853b-89e4-43eb-b4ad-59a12143cead tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d591c10>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:49.670963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b7d8853b-89e4-43eb-b4ad-59a12143cead tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 200 len: 344 microversion: 2.1 time: 0.061522 Jul 25 12:50:49.671893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 461/929] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:50:49 2022] GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:49.721196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:49.721392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:49.732793 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:49.733228 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:49.734033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:49.734489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:49.837459 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:49.844415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:49.845959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1bc5799ac34349518854829ec2c259f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3ed3c23dde49b382ce9016e421e4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:50:49.847167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b09a8b6d-b6a2-4a81-9b69-576fed6f4b0d tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 200 len: 1654 microversion: 2.20 time: 0.130499 Jul 25 12:50:49.847728 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 469/930] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:49 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 1654 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 12:50:49.926235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-77d819b3-f519-4f87-92ab-545d479def27 req-455d1033-85b3-46f4-9425-192157ccbcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "157eacfc-396b-4b94-9c7b-748a8509fbe0", "name": "network-vif-deleted", "tag": "ecd822c9-f7d1-4e6b-b640-cd09dbd2017b"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:49.938413 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-77d819b3-f519-4f87-92ab-545d479def27 req-455d1033-85b3-46f4-9425-192157ccbcfa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:49.939003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-77d819b3-f519-4f87-92ab-545d479def27 req-455d1033-85b3-46f4-9425-192157ccbcfa service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:49.963591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-77d819b3-f519-4f87-92ab-545d479def27 req-455d1033-85b3-46f4-9425-192157ccbcfa service nova] Creating event network-vif-deleted:ecd822c9-f7d1-4e6b-b640-cd09dbd2017b for instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 on hv-cinder-82549 Jul 25 12:50:49.971972 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-77d819b3-f519-4f87-92ab-545d479def27 req-455d1033-85b3-46f4-9425-192157ccbcfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052210 Jul 25 12:50:49.972740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 462/931] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:50.684748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0414e0b1-5995-4a87-9409-2f093af97ab6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d39bf70>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:50.738462 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0414e0b1-5995-4a87-9409-2f093af97ab6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 200 len: 345 microversion: 2.1 time: 0.057587 Jul 25 12:50:50.741930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 470/932] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:50:50 2022] GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:50.753176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-749a09d1-00f3-4886-b227-04458443c4b7 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Action: 'create', calling method: .version_select at 0x7f4c2d3370d0>, body: {"snapshot": {"volume_id": "eda0c15c-b0f9-4135-89a0-d07517b9b32d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1355180016"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:50:50.875325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:50.875930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:50.882764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:50.883442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:50.885051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:50.885480 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:50.901052 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 HTTP/1.1 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:50.902874 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:50.904541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '157eacfc-396b-4b94-9c7b-748a8509fbe0'} Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:50.905432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:50.906893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:50.908817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:50.909776 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b6cde71a-2787-4317-9792-98f4133d26b1 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 404 len: 111 microversion: 2.20 time: 0.039098 Jul 25 12:50:50.910747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 471/933] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:50 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:50:50.922945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-389038d6-28bf-4c9b-abc4-003765837390 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '.version_select at 0x7f4c2d421f70>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:50.943561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-389038d6-28bf-4c9b-abc4-003765837390 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408830358" status: 204 len: 0 microversion: 2.20 time: 0.028318 Jul 25 12:50:50.943789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-749a09d1-00f3-4886-b227-04458443c4b7 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.195255 Jul 25 12:50:50.944443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 463/934] 10.222.0.60 () {60 vars in 1162 bytes} [Mon Jul 25 12:50:50 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:50.947249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 472/935] 10.222.0.60 () {60 vars in 1259 bytes} [Mon Jul 25 12:50:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408830358 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 12:50:50.955763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e28e202d-b59c-488e-a851-c93fe342c8f1 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d591430>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:50.989878 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e28e202d-b59c-488e-a851-c93fe342c8f1 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.037842 Jul 25 12:50:50.991896 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 464/936] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:50 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:51.004302 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-88271a69-1522-4055-8454-67baa0e8f032 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d39aa60>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:51.047670 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-88271a69-1522-4055-8454-67baa0e8f032 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.047781 Jul 25 12:50:51.048360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 473/937] 10.222.0.60 () {58 vars in 1140 bytes} [Mon Jul 25 12:50:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:51.060004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ab971069-11f9-41d8-a3cc-eafe2c41cf59 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d4a2040>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:51.092959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ab971069-11f9-41d8-a3cc-eafe2c41cf59 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.037304 Jul 25 12:50:51.093537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 465/938] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:51 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:52.107307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f0b0df8d-d806-4e55-92a5-96c418aab962 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d42dee0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:52.137671 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f0b0df8d-d806-4e55-92a5-96c418aab962 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.035418 Jul 25 12:50:52.138276 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 474/939] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:52 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:53.150758 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c3b84568-1857-45f0-9e93-9a5f7398203c tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d591a60>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:53.183169 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c3b84568-1857-45f0-9e93-9a5f7398203c tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.037324 Jul 25 12:50:53.183837 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 466/940] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:53 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:54.196949 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cf52c4c6-6b75-425b-a62d-aa9efe6d715f tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d39baf0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:54.226943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cf52c4c6-6b75-425b-a62d-aa9efe6d715f tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.034738 Jul 25 12:50:54.227520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 475/941] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:54 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:55.240450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-91d221ba-b804-4f38-a629-2c291e62ed5b tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d5038b0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:55.271141 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-91d221ba-b804-4f38-a629-2c291e62ed5b tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.035153 Jul 25 12:50:55.271713 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 467/942] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:55 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:55.901383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:55.901929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:55.909128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:55.909575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:55.910533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:55.911120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:55.925687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 HTTP/1.1 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:55.927294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.928779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '157eacfc-396b-4b94-9c7b-748a8509fbe0'} Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:55.929528 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.931646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.933074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:55.933074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-bcc66076-5126-4aba-9f6d-fb253a6390e0 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 404 len: 111 microversion: 2.20 time: 0.031879 Jul 25 12:50:55.933074 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 476/943] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Jul 25 12:50:55 2022] DELETE /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:50:55.938473 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:55.939235 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 157eacfc-396b-4b94-9c7b-748a8509fbe0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:55.946058 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:55.946503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:55.947283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:55.947719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:55.961389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 HTTP/1.1 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:55.963236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.964901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '157eacfc-396b-4b94-9c7b-748a8509fbe0'} Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:55.965722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. Jul 25 12:50:55.967085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:55.968171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 157eacfc-396b-4b94-9c7b-748a8509fbe0 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:55.968171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-63cca833-ba85-453f-8aff-9f16706f2530 tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0" status: 404 len: 111 microversion: 2.20 time: 0.030100 Jul 25 12:50:55.968171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 468/944] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:55 2022] GET /compute/v2.1/servers/157eacfc-396b-4b94-9c7b-748a8509fbe0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:50:56.283846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6781c6bc-db0c-42ad-9926-a461c7d2272b tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d39b040>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:56.313499 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6781c6bc-db0c-42ad-9926-a461c7d2272b tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 288 microversion: 2.1 time: 0.033430 Jul 25 12:50:56.314156 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 477/945] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:56 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:56.325039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e0be974a-2c61-4dc6-a689-92be29031604 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d591e50>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:56.387088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e0be974a-2c61-4dc6-a689-92be29031604 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 202 len: 0 microversion: 2.1 time: 0.065807 Jul 25 12:50:56.387657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 469/946] 10.222.0.60 () {58 vars in 1254 bytes} [Mon Jul 25 12:50:56 2022] DELETE /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 12:50:56.395966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0ecb9ad3-e000-4804-97a2-af527fec62df tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d421940>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:56.427574 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0ecb9ad3-e000-4804-97a2-af527fec62df tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 200 len: 287 microversion: 2.1 time: 0.035314 Jul 25 12:50:56.428140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 478/947] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:56 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:50:57.112208 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:57.112699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:57.120148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:57.120592 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:57.121368 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:57.121805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:57.135397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf HTTP/1.1 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:57.136859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.138541 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf'} Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:57.139363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.140838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.142420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:57.142420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f0d82b62-308b-4c81-8a86-03a4d577dfaa tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 404 len: 111 microversion: 2.20 time: 0.029949 Jul 25 12:50:57.142420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 470/948] 10.222.0.60 () {60 vars in 1280 bytes} [Mon Jul 25 12:50:57 2022] DELETE /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:50:57.147450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:57.148081 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] [instance: 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:50:57.150674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:57.156354 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:57.156792 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:57.157558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:50:57.158006 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:50:57.161448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:57.175900 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] HTTP exception thrown: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Request method failure captured: Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf HTTP/1.1 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3o8JLOAWjo_L__BrnBpVcvY3DIM5uzuOFajewKqy_BT7P00fWFVA4xeIdx_7luNdy5XEEP-ni-DGfuzSaMfrJeuyPjLUZvxWySqVzbIUEFuqVvPlQgr8eLAiyJOi6fb1sj6batOG2LLoqXANANNVEhILeuK9VPSfNgcLxeybHZkszQw Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:57.177438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/df3ed3c23dde49b382ce9016e421e4de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: df3ed3c23dde49b382ce9016e421e4de Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-92572978 Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 1bc5799ac34349518854829ec2c259f9 Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeShelveTestJSON-92572978-project Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.179089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf'} Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:57.179955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. Jul 25 12:50:57.181956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.183226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] Returning 404 to user: Instance 4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:57.183226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-66b02579-3264-49b7-824b-a9184bdc72cf tempest-AttachVolumeShelveTestJSON-92572978 tempest-AttachVolumeShelveTestJSON-92572978-project] 10.222.0.60 "GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf" status: 404 len: 111 microversion: 2.20 time: 0.035934 Jul 25 12:50:57.183226 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 479/949] 10.222.0.60 () {60 vars in 1277 bytes} [Mon Jul 25 12:50:57 2022] GET /compute/v2.1/servers/4c9bf42d-a9fc-434e-a582-c7ccf6fd88bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 12:50:57.441756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2e01d8e5-1af7-46e7-bcf1-845b68b137d6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d4a2ca0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:57.468618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-2e01d8e5-1af7-46e7-bcf1-845b68b137d6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] HTTP exception thrown: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2e01d8e5-1af7-46e7-bcf1-845b68b137d6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Request method failure captured: Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 HTTP/1.1 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pGpCEZe7V_NI9vWy1IlWT_sxkkUzIrLIrM3jtxVAUXbAoDlmhyD6GQO-4HHeo6xZbcb3U5oDIk6aDtxk1fvG9Uit4cn6wPTSleawcZoFPGKVx0y8JXlfeOdvGE_f3gz9jYzs1KYl4MiPxVAf8O6_JSqKM-A9Z-Wwqw4R1eGC4IHIv8 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:57.470883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 1e78d34d4721485bbc0b0fc6a5d67e7a Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'bbf2aadc-08af-41d4-b5e5-f9955a5e8412'} Jul 25 12:50:57.472648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. (HTTP 404) (Request-ID: req-635b2cc1-d57e-42d5-85e0-fc3ae850b9c2) Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.473666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:57.475317 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 12:50:57.477180 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2e01d8e5-1af7-46e7-bcf1-845b68b137d6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Returning 404 to user: Snapshot bbf2aadc-08af-41d4-b5e5-f9955a5e8412 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:57.479480 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2e01d8e5-1af7-46e7-bcf1-845b68b137d6 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412" status: 404 len: 111 microversion: 2.1 time: 0.034710 Jul 25 12:50:57.480434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 471/950] 10.222.0.60 () {58 vars in 1251 bytes} [Mon Jul 25 12:50:57 2022] GET /compute/v2.1/os-snapshots/bbf2aadc-08af-41d4-b5e5-f9955a5e8412 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:57.485873 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8813bbfa-36ec-4b2a-9394-d7d63632c8ea tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d39b790>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:57.552561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8813bbfa-36ec-4b2a-9394-d7d63632c8ea tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 202 len: 0 microversion: 2.1 time: 0.070641 Jul 25 12:50:57.553431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 480/951] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:50:57 2022] DELETE /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:50:57.562794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2adc896f-726e-4648-a4fb-ba36e9ceb8ea tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d503940>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:57.614718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2adc896f-726e-4648-a4fb-ba36e9ceb8ea tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 200 len: 344 microversion: 2.1 time: 0.056947 Jul 25 12:50:57.621190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 472/952] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:50:57 2022] GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:50:58.630515 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c67a3d2-6a5e-4418-b8ea-e084a67d9771 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d42dca0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:58.662147 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-8c67a3d2-6a5e-4418-b8ea-e084a67d9771 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] HTTP exception thrown: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c67a3d2-6a5e-4418-b8ea-e084a67d9771 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Request method failure captured: Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d HTTP/1.1 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pGpCEZe7V_NI9vWy1IlWT_sxkkUzIrLIrM3jtxVAUXbAoDlmhyD6GQO-4HHeo6xZbcb3U5oDIk6aDtxk1fvG9Uit4cn6wPTSleawcZoFPGKVx0y8JXlfeOdvGE_f3gz9jYzs1KYl4MiPxVAf8O6_JSqKM-A9Z-Wwqw4R1eGC4IHIv8 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:58.668530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 1e78d34d4721485bbc0b0fc6a5d67e7a Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'eda0c15c-b0f9-4135-89a0-d07517b9b32d'} Jul 25 12:50:58.670026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. (HTTP 404) (Request-ID: req-f258e7d5-4515-48b3-baf6-9d76a864a859) Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.670914 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:58.672204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:50:58.673351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c67a3d2-6a5e-4418-b8ea-e084a67d9771 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Returning 404 to user: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8c67a3d2-6a5e-4418-b8ea-e084a67d9771 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 404 len: 109 microversion: 2.1 time: 0.045894 Jul 25 12:50:58.674516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 481/953] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:50:58 2022] GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:58.686309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ab1213de-5c2c-4ab5-96aa-ba878f5edc5d tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d49a9d0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:58.716597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-ab1213de-5c2c-4ab5-96aa-ba878f5edc5d tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] HTTP exception thrown: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ab1213de-5c2c-4ab5-96aa-ba878f5edc5d tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Request method failure captured: Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d HTTP/1.1 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pGpCEZe7V_NI9vWy1IlWT_sxkkUzIrLIrM3jtxVAUXbAoDlmhyD6GQO-4HHeo6xZbcb3U5oDIk6aDtxk1fvG9Uit4cn6wPTSleawcZoFPGKVx0y8JXlfeOdvGE_f3gz9jYzs1KYl4MiPxVAf8O6_JSqKM-A9Z-Wwqw4R1eGC4IHIv8 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:50:58.718571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 1e78d34d4721485bbc0b0fc6a5d67e7a Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'eda0c15c-b0f9-4135-89a0-d07517b9b32d'} Jul 25 12:50:58.720164 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. (HTTP 404) (Request-ID: req-b75016d6-09d9-4936-86c5-3d0217d45974) Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.721021 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 12:50:58.722250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 12:50:58.723414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ab1213de-5c2c-4ab5-96aa-ba878f5edc5d tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Returning 404 to user: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ab1213de-5c2c-4ab5-96aa-ba878f5edc5d tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 404 len: 109 microversion: 2.1 time: 0.038088 Jul 25 12:50:58.724634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 473/954] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:50:58 2022] DELETE /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:58.731094 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-55309536-f961-49a0-885c-706169e3b116 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Calling method '.version_select at 0x7f4c2d421940>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:50:58.768640 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-55309536-f961-49a0-885c-706169e3b116 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] HTTP exception thrown: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-55309536-f961-49a0-885c-706169e3b116 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Request method failure captured: Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d HTTP/1.1 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pGpCEZe7V_NI9vWy1IlWT_sxkkUzIrLIrM3jtxVAUXbAoDlmhyD6GQO-4HHeo6xZbcb3U5oDIk6aDtxk1fvG9Uit4cn6wPTSleawcZoFPGKVx0y8JXlfeOdvGE_f3gz9jYzs1KYl4MiPxVAf8O6_JSqKM-A9Z-Wwqw4R1eGC4IHIv8 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:50:58.770925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c8ffe004b4e44ee6b35079502fd74a9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c8ffe004b4e44ee6b35079502fd74a9d Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1497900329 Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 1e78d34d4721485bbc0b0fc6a5d67e7a Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1497900329-project Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'eda0c15c-b0f9-4135-89a0-d07517b9b32d'} Jul 25 12:50:58.772654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. (HTTP 404) (Request-ID: req-acc33dc2-3f03-4916-a506-3053af992dd9) Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.773766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:50:58.775540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:50:58.776966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-55309536-f961-49a0-885c-706169e3b116 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] Returning 404 to user: Volume eda0c15c-b0f9-4135-89a0-d07517b9b32d could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-55309536-f961-49a0-885c-706169e3b116 tempest-VolumesSnapshotsTestJSON-1497900329 tempest-VolumesSnapshotsTestJSON-1497900329-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d" status: 404 len: 109 microversion: 2.1 time: 0.045692 Jul 25 12:50:58.778395 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 482/955] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:50:58 2022] GET /compute/v2.1/os-volumes/eda0c15c-b0f9-4135-89a0-d07517b9b32d => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:51:02.439134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-82dd87ad-9276-4662-a539-0b286f254802 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Action: 'create', calling method: .version_select at 0x7f4c2d58f820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-864699265", "metadata": {"Type": "work"}}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:02.804916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-82dd87ad-9276-4662-a539-0b286f254802 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.503221 Jul 25 12:51:02.806332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 474/956] 10.222.0.60 () {60 vars in 1156 bytes} [Mon Jul 25 12:51:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 505 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 12:51:02.819323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-78a25388-bebe-4953-a3f9-23cdc4878140 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d4f9e50>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:02.874541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-78a25388-bebe-4953-a3f9-23cdc4878140 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 200 len: 352 microversion: 2.1 time: 0.059443 Jul 25 12:51:02.875117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 483/957] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:51:02 2022] GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:03.889048 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8bd56f15-6101-4b05-b3d2-3f4a51ffb2b4 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d4a2dc0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:03.939006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8bd56f15-6101-4b05-b3d2-3f4a51ffb2b4 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 200 len: 353 microversion: 2.1 time: 0.053605 Jul 25 12:51:03.939632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 475/958] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:51:03 2022] GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:03.953793 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-99a687c6-6d44-4e36-9e4a-f66a60f59912 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d46c8b0>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:04.004288 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-99a687c6-6d44-4e36-9e4a-f66a60f59912 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 200 len: 353 microversion: 2.1 time: 0.055560 Jul 25 12:51:04.004857 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 484/959] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:51:03 2022] GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:04.027542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3b78d498-1440-4cc0-8445-1bca998ea6b3 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d58f310>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:04.093045 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3b78d498-1440-4cc0-8445-1bca998ea6b3 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 202 len: 0 microversion: 2.1 time: 0.071790 Jul 25 12:51:04.093625 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 476/960] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:51:04 2022] DELETE /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:51:04.101769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cb606c90-73e4-47ed-a605-d5349bcdfaa5 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d3add30>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:04.154224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cb606c90-73e4-47ed-a605-d5349bcdfaa5 tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 200 len: 352 microversion: 2.1 time: 0.056313 Jul 25 12:51:04.154800 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 485/961] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:51:04 2022] GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:05.169725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f01e93f7-4339-4aab-a71f-5a89cda756ac tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Calling method '.version_select at 0x7f4c2d5900d0>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:05.200455 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-f01e93f7-4339-4aab-a71f-5a89cda756ac tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] HTTP exception thrown: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f01e93f7-4339-4aab-a71f-5a89cda756ac tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Request method failure captured: Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 HTTP/1.1 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pG2CaoEMier39e9PD-ckxNLK7OU9u4N6u_1bRaejU1cJk5jdrUG3mvDwwOT6LokQl2H-Z_nOYSiaM0WgEtXF1o4AqT9PIemQkMArelnWvLc8IcEc5IVXf_-w6HHdk__ma0kaL8GQiILUiDLtn7UmybmTSCiWU3z5mfwvuRu8GiOTGM Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: a89ad1e525364d3787f0643e8104a532 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesGetTestJSON-1557645008 Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:51:05.202407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a89ad1e525364d3787f0643e8104a532"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a89ad1e525364d3787f0643e8104a532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a89ad1e525364d3787f0643e8104a532"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a89ad1e525364d3787f0643e8104a532"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesGetTestJSON-1557645008 Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: a89ad1e525364d3787f0643e8104a532 Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesGetTestJSON-1557645008 Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesGetTestJSON-1557645008-project Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 2f0dfc223e54438788758f115fb02eab Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesGetTestJSON-1557645008-project Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '10e47288-098e-492d-9400-a44288e15f01'} Jul 25 12:51:05.205513 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. (HTTP 404) (Request-ID: req-7e8a5b14-989a-4c84-b0a4-6d6770e2228b) Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:05.207300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 12:51:05.209616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 12:51:05.212840 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f01e93f7-4339-4aab-a71f-5a89cda756ac tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] Returning 404 to user: Volume 10e47288-098e-492d-9400-a44288e15f01 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f01e93f7-4339-4aab-a71f-5a89cda756ac tempest-VolumesGetTestJSON-1557645008 tempest-VolumesGetTestJSON-1557645008-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01" status: 404 len: 109 microversion: 2.1 time: 0.039490 Jul 25 12:51:05.216018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 477/962] 10.222.0.60 () {58 vars in 1245 bytes} [Mon Jul 25 12:51:05 2022] GET /compute/v2.1/os-volumes/10e47288-098e-492d-9400-a44288e15f01 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:51:07.874197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:07.874965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:07.878956 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:07.879522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:07.887073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:07.887525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:07.888296 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:07.888732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:07.970823 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lazy-loading 'services' on Instance uuid f1a64767-90c8-40a7-9019-4054dd86361e {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:51:08.044366 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e27b8135-3d7a-4d0a-875e-ccb05b707b33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments/bef45108-3117-4cba-b56c-b1cf557af66e" status: 202 len: 0 microversion: 2.1 time: 0.171208 Jul 25 12:51:08.045027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 486/963] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:51:07 2022] DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments/bef45108-3117-4cba-b56c-b1cf557af66e => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:51:09.181631 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:09.182606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:09.187321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3f51dee7-2ca3-4fe2-93f2-cb13a357c086 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:09.198320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3f51dee7-2ca3-4fe2-93f2-cb13a357c086 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.199092 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3f51dee7-2ca3-4fe2-93f2-cb13a357c086 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.228733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3f51dee7-2ca3-4fe2-93f2-cb13a357c086 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Going to try to stop instance {{(pid=129815) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 12:51:09.279475 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3f51dee7-2ca3-4fe2-93f2-cb13a357c086 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action" status: 202 len: 0 microversion: 2.1 time: 0.099568 Jul 25 12:51:09.280244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 478/964] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:51:09 2022] POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:51:09.290511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:09.291448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:09.297803 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.298280 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.299044 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:09.299748 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:09.442131 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:09.449688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-19a18890-60d7-47dc-bdeb-20c60af3ffdc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.164479 Jul 25 12:51:09.450286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 487/965] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:09 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:10.472619 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:10.473358 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:10.480152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:10.483980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:10.483980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:10.483980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:10.629314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:10.637447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-22be4753-c444-46e8-a453-d9866d4bdf44 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.169542 Jul 25 12:51:10.638089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 479/966] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:10 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:11.658239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:11.658854 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:11.665398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:11.665845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:11.666650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:11.667076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:11.809237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:11.816624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8295f4b4-4ead-4a5b-a7a9-35444f2db6c8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.162138 Jul 25 12:51:11.817204 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 488/967] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:11 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:12.839275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:12.840072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:12.847199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:12.847686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:12.848477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:12.848911 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:12.983970 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:12.991709 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c657f2b6-241c-4764-a6f2-489a3a448016 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.156969 Jul 25 12:51:12.992292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 480/968] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:12 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:14.013554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:14.014130 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:14.020448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:14.020884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:14.021636 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:14.022092 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:14.156910 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:14.164877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ed97c2df-26e4-4362-95f5-c848ba0a70f3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.155564 Jul 25 12:51:14.166033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 489/969] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:14 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:15.193642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:15.194856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:15.201823 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:15.202779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:15.203159 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:15.203512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:15.345516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:15.354351 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b8c5a363-4243-4724-8f6f-1a8abcd13ae9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.164510 Jul 25 12:51:15.355003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 481/970] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:15 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:16.376619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:16.377234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:16.383851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:16.385292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:16.385618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:16.386084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:16.518319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:16.526597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a18d57e3-e8b0-4011-9077-9872f533755c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.153591 Jul 25 12:51:16.527386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 490/971] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:16 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:17.547464 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:17.548071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:17.554736 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:17.555183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:17.555962 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:17.556392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:17.705176 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:17.713593 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5a7b0ca7-989f-453f-8d31-872f9969bbb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.169942 Jul 25 12:51:17.714224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 482/972] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:17 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:18.735539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:18.736062 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:18.742781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:18.743780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:18.744566 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:18.745002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:18.871841 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:18.879203 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5eb0ad1b-be6e-4236-8393-e76bbf5a30b9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1678 microversion: 2.1 time: 0.147930 Jul 25 12:51:18.879762 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 491/973] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:18 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:19.900231 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:19.900952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:19.907616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:19.908060 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:19.908831 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:19.909269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:20.092714 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:20.100584 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-35079ea3-f65c-4b25-bc1c-653d1a22bbe2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1655 microversion: 2.1 time: 0.204816 Jul 25 12:51:20.101166 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 483/974] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:19 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1655 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:20.122932 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a74e8727-4352-4762-9853-71c33f70d9cd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:20.129353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a74e8727-4352-4762-9853-71c33f70d9cd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:20.129692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a74e8727-4352-4762-9853-71c33f70d9cd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:20.156116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a74e8727-4352-4762-9853-71c33f70d9cd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Going to try to start instance {{(pid=129816) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 12:51:20.210262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a74e8727-4352-4762-9853-71c33f70d9cd tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action" status: 202 len: 0 microversion: 2.1 time: 0.091470 Jul 25 12:51:20.210875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 492/975] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:51:20 2022] POST /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:51:20.226369 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:20.226997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:20.238906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:20.239368 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:20.240169 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:20.240795 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:20.397641 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:20.412086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8f57c01d-89cd-480c-a6f7-b2d5617cccfb tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1664 microversion: 2.1 time: 0.196382 Jul 25 12:51:20.412885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 484/976] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:20 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:21.437551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:21.438337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:21.452944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:21.452944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:21.452944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:21.452944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:21.608845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:51:21.609088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 12:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e (ip 10.222.0.60) !!! Jul 25 12:51:21.752689 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:21.769017 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-65eaf88e-9e91-4b3f-986c-6528fcfa13c6 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1664 microversion: 2.1 time: 0.335626 Jul 25 12:51:21.777371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 493/977] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:21 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1664 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:22.813022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:22.814392 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:22.821136 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:22.821733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:22.822538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:22.822968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:22.984291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:22.992302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7637b370-f29e-489c-bf6b-3a65d4ff5913 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1668 microversion: 2.1 time: 0.183045 Jul 25 12:51:22.992832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 485/978] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:22 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:34.192699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1111606315", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "networks": [{"uuid": "bb1b3010-8dc3-4806-9835-05ae48533627"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:34.202051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=16 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:34.202696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:34.252896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] validate_networks() for [('bb1b3010-8dc3-4806-9835-05ae48533627', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:51:34.658354 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:51:34.658777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:51:34.659250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:51:34.659661 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:51:34.660071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:51:34.669392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:34.669845 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:34.670688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:34.671124 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:34.688335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Getting quotas for project 5572f729d7c7487c9619292573b90d70. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:34.692305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Getting quotas for user a20445f40949478ca549f6df3d9dbd03 and project 5572f729d7c7487c9619292573b90d70. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:34.703250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:51:34.705510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:51:34.758522 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f470751d-1ad2-4c65-b349-698b15e675a2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569691 Jul 25 12:51:34.759221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 494/979] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:51:34.770142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e170d7be-8d88-4537-9757-62a1f05b3f30 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:34.770751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e170d7be-8d88-4537-9757-62a1f05b3f30 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:34.773320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=16 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:34.774125 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:34.836458 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e170d7be-8d88-4537-9757-62a1f05b3f30 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:34.843351 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e170d7be-8d88-4537-9757-62a1f05b3f30 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1214 microversion: 2.1 time: 0.077163 Jul 25 12:51:34.843923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 486/980] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:34 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:35.864999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:35.865638 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:35.872870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:35.873308 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:35.874098 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:35.874525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:35.935531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:35.942836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9f523efb-15a8-4caf-8568-714b72e82455 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1218 microversion: 2.1 time: 0.082155 Jul 25 12:51:35.943389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 495/981] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:35 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:36.964794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:36.965402 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:36.972923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:36.973363 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:36.974157 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:36.974581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:37.043953 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:37.055186 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-93e8c3ce-6217-412c-bcba-71be11674d2a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1218 microversion: 2.1 time: 0.094610 Jul 25 12:51:37.056202 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 487/982] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:36 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:38.081572 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:38.082205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:38.089495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:38.090073 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:38.091139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:38.091605 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:38.174810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:38.189788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-59e4d478-50fc-47f1-b5b3-0773e8ee7852 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1266 microversion: 2.1 time: 0.106990 Jul 25 12:51:38.189788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 496/983] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:38 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:39.212575 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:39.215093 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:39.222754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.223200 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.223985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.224770 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.373782 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:39.381579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4cab182b-f0d1-442e-9085-70cc7cdb2353 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.172787 Jul 25 12:51:39.382208 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 488/984] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:39 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:39.761187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-5b210568-9d65-425c-b69d-8dfd23cbc7fd req-550faf31-c896-4fe1-aeee-4ea15d1b5bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650fdd32-306e-403d-b954-b4748293a88b", "tag": "cc18a540-4627-4c6b-a62a-cc01ed789393"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:39.774216 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5b210568-9d65-425c-b69d-8dfd23cbc7fd req-550faf31-c896-4fe1-aeee-4ea15d1b5bea service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:39.774558 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5b210568-9d65-425c-b69d-8dfd23cbc7fd req-550faf31-c896-4fe1-aeee-4ea15d1b5bea service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:39.790496 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-5b210568-9d65-425c-b69d-8dfd23cbc7fd req-550faf31-c896-4fe1-aeee-4ea15d1b5bea service nova] Creating event network-changed:cc18a540-4627-4c6b-a62a-cc01ed789393 for instance 650fdd32-306e-403d-b954-b4748293a88b on hv-cinder-82549 Jul 25 12:51:39.798614 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-5b210568-9d65-425c-b69d-8dfd23cbc7fd req-550faf31-c896-4fe1-aeee-4ea15d1b5bea service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201995 Jul 25 12:51:39.799236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 497/985] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:40.405589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:40.406242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:40.413984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:40.414705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:40.415992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:40.417258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:40.590089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:40.598115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e063128f-ec34-4764-b6d4-d7bb69489fa0 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.197281 Jul 25 12:51:40.598689 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 489/986] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:40 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:41.621083 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:41.621774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:41.628209 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:41.628651 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:41.629415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:41.629846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:41.774738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:41.786142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9c2f1072-cd80-4a41-bea1-3be1038d8701 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.170214 Jul 25 12:51:41.786724 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 498/987] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:41 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:42.808741 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:42.809538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:42.816028 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.816470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:42.817236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:42.817673 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:42.952581 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:42.961431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cf13b018-1af6-44f7-8b1b-4ca1e907bd1b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.157227 Jul 25 12:51:42.962059 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 490/988] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:42 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:43.983387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:43.983958 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:43.990423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:43.990860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:43.991621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:43.992045 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:44.134627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:44.144848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-283e5078-1d99-4514-8599-4fd7cc98ec5a tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.165645 Jul 25 12:51:44.152530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 499/989] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:43 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:45.166291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:45.166907 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:45.169325 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.175240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:45.175688 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:45.176468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:45.176900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:45.316153 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:45.323966 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2b9814ca-ee00-4255-ad1c-bcdc66f6a552 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.161618 Jul 25 12:51:45.324537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 491/990] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:45 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:46.345282 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:46.345901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:46.347911 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.348575 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.355777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.356224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.357001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:46.357437 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:46.490244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:46.498066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0675f086-d7f4-4f77-a293-14e7b39f94b2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.156567 Jul 25 12:51:46.498665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 500/991] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:46 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:47.360703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-a5ce0abc-63f5-4a3d-b283-8569341fafae req-26b61ec9-6e80-41aa-bf2c-d3781bdbf09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fdd32-306e-403d-b954-b4748293a88b", "name": "network-vif-plugged", "status": "completed", "tag": "cc18a540-4627-4c6b-a62a-cc01ed789393"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:47.370980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a5ce0abc-63f5-4a3d-b283-8569341fafae req-26b61ec9-6e80-41aa-bf2c-d3781bdbf09c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:47.371475 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-a5ce0abc-63f5-4a3d-b283-8569341fafae req-26b61ec9-6e80-41aa-bf2c-d3781bdbf09c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:47.383171 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-a5ce0abc-63f5-4a3d-b283-8569341fafae req-26b61ec9-6e80-41aa-bf2c-d3781bdbf09c service nova] Creating event network-vif-plugged:cc18a540-4627-4c6b-a62a-cc01ed789393 for instance 650fdd32-306e-403d-b954-b4748293a88b on hv-cinder-82549 Jul 25 12:51:47.388637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-a5ce0abc-63f5-4a3d-b283-8569341fafae req-26b61ec9-6e80-41aa-bf2c-d3781bdbf09c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031994 Jul 25 12:51:47.389404 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 492/992] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:47.518835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:47.519450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:47.525893 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:47.526922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:47.527681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:47.528111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:47.658583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:47.666057 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e2576ad7-de1a-41f7-b83e-5e3b014db599 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.151037 Jul 25 12:51:47.666623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 501/993] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:47 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:48.687760 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:48.688590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:48.695114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:48.695557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:48.696343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:48.696771 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:48.832437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:48.840791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1421cca0-fb8a-4a55-8f1f-afde373f7b7e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.157632 Jul 25 12:51:48.841416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 493/994] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:48 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:49.862448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:49.863064 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:49.869286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:49.869729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:49.870541 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:49.870976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:50.000289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:50.008079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ec27648d-d427-4b90-8b62-b953784048e8 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1314 microversion: 2.1 time: 0.149930 Jul 25 12:51:50.008711 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 502/995] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:49 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:51.030081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.030625 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:51.037099 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.037571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.038365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.038801 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.172139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:51.180085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2f89adf9-ed8a-451c-8a10-525be330d672 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1498 microversion: 2.1 time: 0.154098 Jul 25 12:51:51.180284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 494/996] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:51.699608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.700740 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:51.707771 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.708523 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.709563 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.710568 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.758898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:51:51.850157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-afb3e195-c689-4d56-a562-dc6b0a136824 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 204 len: 0 microversion: 2.1 time: 0.154310 Jul 25 12:51:51.850794 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 503/997] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:51:51 2022] DELETE /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:51:51.860406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:51.861024 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:51.867522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.867978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:51.869197 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:51.869947 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:52.025598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:52.033460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-919b730a-c7d2-48fb-9249-c5ea4d7d6e71 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1504 microversion: 2.1 time: 0.177115 Jul 25 12:51:52.034227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 495/998] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:51 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:53.057263 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:53.058505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:53.064953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:53.065400 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:53.066178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:53.066795 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:53.256434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:53.265773 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-09d45867-a59a-4e65-b3f8-5685ffda4ab1 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1504 microversion: 2.1 time: 0.213484 Jul 25 12:51:53.266831 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 504/999] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:53 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:51:53.946198 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-80e944cb-619a-462c-ac06-40444cacd6ce req-6c60f806-2d18-4dc0-b2e1-4ad8e5eb7647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fdd32-306e-403d-b954-b4748293a88b", "name": "network-vif-deleted", "tag": "cc18a540-4627-4c6b-a62a-cc01ed789393"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:53.957805 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-80e944cb-619a-462c-ac06-40444cacd6ce req-6c60f806-2d18-4dc0-b2e1-4ad8e5eb7647 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:53.958371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-80e944cb-619a-462c-ac06-40444cacd6ce req-6c60f806-2d18-4dc0-b2e1-4ad8e5eb7647 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:53.970309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-80e944cb-619a-462c-ac06-40444cacd6ce req-6c60f806-2d18-4dc0-b2e1-4ad8e5eb7647 service nova] Creating event network-vif-deleted:cc18a540-4627-4c6b-a62a-cc01ed789393 for instance 650fdd32-306e-403d-b954-b4748293a88b on hv-cinder-82549 Jul 25 12:51:53.975702 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-80e944cb-619a-462c-ac06-40444cacd6ce req-6c60f806-2d18-4dc0-b2e1-4ad8e5eb7647 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 Jul 25 12:51:53.976340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 496/1000] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:51:54.286485 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:54.287089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:54.293319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.293754 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.294546 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.294970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.330189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:54.330629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:54.331200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lazy-loading 'fault' on Instance uuid 650fdd32-306e-403d-b954-b4748293a88b {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:51:54.375681 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:54.384053 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-159ede3a-325b-424c-897f-7f28449055b3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 200 len: 1304 microversion: 2.1 time: 0.101206 Jul 25 12:51:54.384612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 505/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:54 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:55.408151 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:55.408878 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 650fdd32-306e-403d-b954-b4748293a88b] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:55.415901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.416378 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.417752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.418290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.431483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] HTTP exception thrown: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Request method failure captured: Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b HTTP/1.1 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pHU9G-ahhihAjp467rYddVFBN14SjR1o32ixLSLCjJHs4_jRb2dkt9KeLCvPZ4VaAzLaHZbctw-j3p_zsudpRrUvJPnQ0hFW2r2Oi4EYsrluBvuM20VNqNWRrmXqxS-DF6o2wwlcD5ufqdxpYtc_wAcl_GYcq2he_habkvjK67sq7E Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 5572f729d7c7487c9619292573b90d70 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesActionsTest-969305180 Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:51:55.433158 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5572f729d7c7487c9619292573b90d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5572f729d7c7487c9619292573b90d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5572f729d7c7487c9619292573b90d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5572f729d7c7487c9619292573b90d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesActionsTest-969305180 Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 5572f729d7c7487c9619292573b90d70 Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesActionsTest-969305180 Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesActionsTest-969305180-project Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: a20445f40949478ca549f6df3d9dbd03 Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesActionsTest-969305180-project Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. Jul 25 12:51:55.434587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '650fdd32-306e-403d-b954-b4748293a88b'} Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:51:55.435434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. Jul 25 12:51:55.436761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:51:55.438006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Returning 404 to user: Instance 650fdd32-306e-403d-b954-b4748293a88b could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:51:55.438006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c4ea8052-9f56-4c26-a81d-d49165c5d80f tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b" status: 404 len: 111 microversion: 2.1 time: 0.031132 Jul 25 12:51:55.438006 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 497/1002] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:55 2022] GET /compute/v2.1/servers/650fdd32-306e-403d-b954-b4748293a88b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:51:55.574495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2091263202", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "networks": [{"uuid": "bb1b3010-8dc3-4806-9835-05ae48533627"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:55.634258 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] validate_networks() for [('bb1b3010-8dc3-4806-9835-05ae48533627', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:51:55.976054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:51:55.976473 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:51:55.976940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:51:55.977343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:51:55.977746 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:51:55.986851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.987292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:55.988084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:55.988512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:56.006456 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Getting quotas for project 5572f729d7c7487c9619292573b90d70. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:51:56.010371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Getting quotas for user a20445f40949478ca549f6df3d9dbd03 and project 5572f729d7c7487c9619292573b90d70. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:51:56.021730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:51:56.024014 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:51:56.068169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4bcce8c0-0715-4d5f-9667-00d71ae951e3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498520 Jul 25 12:51:56.068817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 506/1003] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:51:56.080323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-391bfa5f-da6d-4fe9-a470-3f554f438df7 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:56.080900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-391bfa5f-da6d-4fe9-a470-3f554f438df7 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:56.135568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-391bfa5f-da6d-4fe9-a470-3f554f438df7 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:56.143206 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-391bfa5f-da6d-4fe9-a470-3f554f438df7 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1214 microversion: 2.1 time: 0.066742 Jul 25 12:51:56.143786 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 498/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:56 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:57.165004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:57.165619 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:57.173677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:57.173831 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:57.174673 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:57.175109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:57.257694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:57.265954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0a3c4942-2dbf-49d6-92ee-2395f08d5ba6 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1272 microversion: 2.1 time: 0.105289 Jul 25 12:51:57.266642 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 507/1005] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:57 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:58.288698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:58.289568 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:58.298691 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.299332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.300331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.300928 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.446506 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-fb15d745-f87f-4848-98bc-35b3600e70f3 req-4f1951b7-d432-4222-aa26-bc88c3838533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540b3b21-4a7b-4c98-9976-5405cad5a5d0", "tag": "e57082e2-64f4-4b82-9672-306e2583158e"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:51:58.466605 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-fb15d745-f87f-4848-98bc-35b3600e70f3 req-4f1951b7-d432-4222-aa26-bc88c3838533 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:58.467299 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-fb15d745-f87f-4848-98bc-35b3600e70f3 req-4f1951b7-d432-4222-aa26-bc88c3838533 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:58.474315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:58.483968 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-fb15d745-f87f-4848-98bc-35b3600e70f3 req-4f1951b7-d432-4222-aa26-bc88c3838533 service nova] Creating event network-changed:e57082e2-64f4-4b82-9672-306e2583158e for instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 on hv-cinder-82549 Jul 25 12:51:58.484761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-becccd79-e4ff-4e41-8f70-36695c856624 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.200646 Jul 25 12:51:58.485703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 499/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:58 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:51:58.489484 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-fb15d745-f87f-4848-98bc-35b3600e70f3 req-4f1951b7-d432-4222-aa26-bc88c3838533 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048614 Jul 25 12:51:58.490264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 508/1007] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:51:59.516984 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:51:59.517600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:51:59.524001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:59.524486 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:59.525200 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:51:59.525628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:51:59.665064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:51:59.673318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5c67b787-6575-447a-9f0c-a41522c599fb tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.160256 Jul 25 12:51:59.674047 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 500/1008] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:51:59 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:00.696362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:00.696819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:00.704077 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.704530 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.705553 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:00.705934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:00.842266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:00.849588 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4c8b9958-4433-4aa8-bebc-ef554496b29b tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.158245 Jul 25 12:52:00.850291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 509/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:00 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:01.871306 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:01.871909 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:01.878450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:01.878903 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:01.879667 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:01.880100 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:02.013214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:02.020982 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c97d3cc0-3435-45eb-8921-e2f25a14dd51 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.153492 Jul 25 12:52:02.021562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 501/1010] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:01 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:03.043165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:03.043806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:03.050364 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.050818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.051593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:03.052029 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:03.195881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:03.203859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ea870504-ffdf-46c9-84a2-af94f0acfb35 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.165238 Jul 25 12:52:03.204742 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 510/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:03 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:04.225518 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:04.226247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:04.233338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:04.234134 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:04.234863 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:04.235274 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:04.367856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:04.375237 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-597f2da2-df98-4afe-930e-f1342cdf5948 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.154225 Jul 25 12:52:04.375797 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 502/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:04 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:04.769897 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-05288bf3-80f6-4785-b0cd-24358fd5beab req-e5cd687a-f305-42bf-acc4-1330b88a6d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540b3b21-4a7b-4c98-9976-5405cad5a5d0", "name": "network-vif-plugged", "status": "completed", "tag": "e57082e2-64f4-4b82-9672-306e2583158e"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:04.775218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:04.782180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-05288bf3-80f6-4785-b0cd-24358fd5beab req-e5cd687a-f305-42bf-acc4-1330b88a6d61 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:04.782623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-05288bf3-80f6-4785-b0cd-24358fd5beab req-e5cd687a-f305-42bf-acc4-1330b88a6d61 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:04.787390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:04.796019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-05288bf3-80f6-4785-b0cd-24358fd5beab req-e5cd687a-f305-42bf-acc4-1330b88a6d61 service nova] Creating event network-vif-plugged:e57082e2-64f4-4b82-9672-306e2583158e for instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 on hv-cinder-82549 Jul 25 12:52:04.801654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-05288bf3-80f6-4785-b0cd-24358fd5beab req-e5cd687a-f305-42bf-acc4-1330b88a6d61 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189131 Jul 25 12:52:04.802340 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 511/1013] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:05.395934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:05.396537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:05.398918 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=39 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:05.404105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:05.404545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:05.405293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:05.405721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:05.408477 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=79 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:05.542487 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:05.551004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-86f5deef-6902-457f-9a8e-0c0fcd319aa5 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.158987 Jul 25 12:52:05.551570 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 503/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:05 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:06.570264 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:06.571101 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:06.576306 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:06.577000 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:06.585593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:06.586132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:06.586892 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:06.587323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:06.725611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:06.733880 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1c665d78-5bd4-44a4-a6ff-73881faaaea3 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1314 microversion: 2.1 time: 0.164926 Jul 25 12:52:06.734479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 512/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:06 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:07.754875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:07.755506 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:07.757313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:07.763773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:07.764230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:07.765004 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:07.765443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:07.910366 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:07.918216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d559fd45-f474-42ae-a832-356452f90de2 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1497 microversion: 2.1 time: 0.167382 Jul 25 12:52:07.918794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 504/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:07 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:08.521448 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:08.522151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:08.528648 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.529080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.529830 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.530293 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.558243 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:52:08.638580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-14a6c0e9-493a-42f1-b2ff-d4ea40ba9e25 tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "DELETE /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 204 len: 0 microversion: 2.1 time: 0.120638 Jul 25 12:52:08.639464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 513/1017] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:08 2022] DELETE /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:52:08.649219 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:08.649824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:08.655917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.656355 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.657110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:08.657531 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:08.807450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:08.815632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-aaf45f37-fe1a-4675-8710-55026d41edae tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1503 microversion: 2.1 time: 0.170228 Jul 25 12:52:08.816218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 505/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:08 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:09.838310 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:09.838940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:09.845382 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:09.845826 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:09.846620 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:09.847052 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:09.995058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:10.003781 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9eadcaa8-452b-4fd8-97ee-4e9dac5215ef tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1503 microversion: 2.1 time: 0.169824 Jul 25 12:52:10.004361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 514/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:09 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:10.759437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-0b2aa7ac-e1f4-4689-b347-e930da4ebde6 req-c58c91f4-6c10-4b5b-856b-62685a9a7e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540b3b21-4a7b-4c98-9976-5405cad5a5d0", "name": "network-vif-deleted", "tag": "e57082e2-64f4-4b82-9672-306e2583158e"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:10.775397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0b2aa7ac-e1f4-4689-b347-e930da4ebde6 req-c58c91f4-6c10-4b5b-856b-62685a9a7e94 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:10.775397 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0b2aa7ac-e1f4-4689-b347-e930da4ebde6 req-c58c91f4-6c10-4b5b-856b-62685a9a7e94 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:10.784749 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-0b2aa7ac-e1f4-4689-b347-e930da4ebde6 req-c58c91f4-6c10-4b5b-856b-62685a9a7e94 service nova] Creating event network-vif-deleted:e57082e2-64f4-4b82-9672-306e2583158e for instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 on hv-cinder-82549 Jul 25 12:52:10.790496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-0b2aa7ac-e1f4-4689-b347-e930da4ebde6 req-c58c91f4-6c10-4b5b-856b-62685a9a7e94 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034672 Jul 25 12:52:10.791429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 506/1020] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:11.025596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:11.026018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:11.032657 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:11.033102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:11.033864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:11.034331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:11.070632 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:11.071079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:11.071526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lazy-loading 'fault' on Instance uuid 540b3b21-4a7b-4c98-9976-5405cad5a5d0 {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:52:11.118463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a20445f40949478ca549f6df3d9dbd03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5572f729d7c7487c9619292573b90d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:11.126769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-090f38f5-0f90-4913-8610-c2dab012226e tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 200 len: 1304 microversion: 2.1 time: 0.105691 Jul 25 12:52:11.127438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 515/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:11 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:12.149711 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:12.150449 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] [instance: 540b3b21-4a7b-4c98-9976-5405cad5a5d0] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:12.158534 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.158978 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.159792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:12.160278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:12.174611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] HTTP exception thrown: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Request method failure captured: Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 HTTP/1.1 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pHU9G-ahhihAjp467rYddVFBN14SjR1o32ixLSLCjJHs4_jRb2dkt9KeLCvPZ4VaAzLaHZbctw-j3p_zsudpRrUvJPnQ0hFW2r2Oi4EYsrluBvuM20VNqNWRrmXqxS-DF6o2wwlcD5ufqdxpYtc_wAcl_GYcq2he_habkvjK67sq7E Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 5572f729d7c7487c9619292573b90d70 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-VolumesActionsTest-969305180 Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:52:12.176448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5572f729d7c7487c9619292573b90d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5572f729d7c7487c9619292573b90d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5572f729d7c7487c9619292573b90d70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5572f729d7c7487c9619292573b90d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-VolumesActionsTest-969305180 Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 5572f729d7c7487c9619292573b90d70 Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-VolumesActionsTest-969305180 Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-VolumesActionsTest-969305180-project Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: a20445f40949478ca549f6df3d9dbd03 Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-VolumesActionsTest-969305180-project Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. Jul 25 12:52:12.179216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '540b3b21-4a7b-4c98-9976-5405cad5a5d0'} Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:12.180510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. Jul 25 12:52:12.183545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:12.184833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] Returning 404 to user: Instance 540b3b21-4a7b-4c98-9976-5405cad5a5d0 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:12.184833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-08891110-02a1-4ff0-898a-99f47f2900fd tempest-VolumesActionsTest-969305180 tempest-VolumesActionsTest-969305180-project] 10.222.0.60 "GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0" status: 404 len: 111 microversion: 2.1 time: 0.032890 Jul 25 12:52:12.184833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 507/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:12 2022] GET /compute/v2.1/servers/540b3b21-4a7b-4c98-9976-5405cad5a5d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:18.942984 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-568913168", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:19.018854 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] validate_networks() for None {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:52:19.700988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:19.701812 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:19.702654 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:19.703701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:19.704321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:19.715821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:19.716505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:19.717527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:19.718066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:19.739814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Getting quotas for project b678cb6fa6b340ae9cfc877a240ab213. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:19.746285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Getting quotas for user b953dd2dc515426683501b4207839548 and project b678cb6fa6b340ae9cfc877a240ab213. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:19.767224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:19.769493 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:19.831054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e98dfcaf-0d24-4467-8b8a-ce9a27bad5c0 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891984 Jul 25 12:52:19.837625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 516/1023] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:52:19.842597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-381fde1d-0cc6-4b92-a72d-5b66fd36585e tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:19.843199 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-381fde1d-0cc6-4b92-a72d-5b66fd36585e tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:19.913882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-381fde1d-0cc6-4b92-a72d-5b66fd36585e tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:19.928254 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-381fde1d-0cc6-4b92-a72d-5b66fd36585e tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1214 microversion: 2.1 time: 0.089260 Jul 25 12:52:19.941950 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 508/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:19 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:20.964098 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:20.965392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:20.974724 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:20.975543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:20.976513 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:20.977042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:21.059656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:21.084721 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-113fb648-4f5e-4ba4-9629-b710f1fd6803 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1266 microversion: 2.1 time: 0.126440 Jul 25 12:52:21.085315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 517/1025] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:20 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:22.111142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:22.113289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:22.124450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:22.125712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.126959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:22.127579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:22.232016 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:22.242718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-68b92c5c-696c-493a-b391-4bb2c9b0fed6 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1272 microversion: 2.1 time: 0.138473 Jul 25 12:52:22.243788 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 509/1026] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:22 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:23.267410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:23.268297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:23.283466 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.284881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.285866 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.287143 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.439802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-99b1fa4a-8587-429f-b5e5-2c1cee63fe78 req-52b3d40d-109b-47e0-ad4c-bb3943d16e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aef4fc2-5ba5-4e3b-afd3-24d50217ee37", "tag": "ca8da65d-bf70-4bd8-905a-95de16f3a998"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:23.493956 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-99b1fa4a-8587-429f-b5e5-2c1cee63fe78 req-52b3d40d-109b-47e0-ad4c-bb3943d16e27 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:23.510402 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-99b1fa4a-8587-429f-b5e5-2c1cee63fe78 req-52b3d40d-109b-47e0-ad4c-bb3943d16e27 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:23.534211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-99b1fa4a-8587-429f-b5e5-2c1cee63fe78 req-52b3d40d-109b-47e0-ad4c-bb3943d16e27 service nova] Creating event network-changed:ca8da65d-bf70-4bd8-905a-95de16f3a998 for instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 on hv-cinder-82549 Jul 25 12:52:23.543005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-99b1fa4a-8587-429f-b5e5-2c1cee63fe78 req-52b3d40d-109b-47e0-ad4c-bb3943d16e27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105913 Jul 25 12:52:23.544396 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 510/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:23.599561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:23.626927 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b9cef3ae-d3b5-4052-8d39-de6c42297ffe tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.363505 Jul 25 12:52:23.628007 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 518/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:23 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:24.655511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:24.656269 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:24.662791 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:24.663242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:24.664002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:24.664670 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:24.832203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:24.844806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-56e462b0-92a7-44c4-9e52-a23136fb99aa tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.199699 Jul 25 12:52:24.846034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 511/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:24 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:25.867445 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:25.868078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:25.876248 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.876703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:25.877484 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:25.877934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:26.037843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:26.046287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7b878c1e-d0bb-4946-94bb-022e8253760b tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.183715 Jul 25 12:52:26.046879 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 519/1030] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:25 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:27.072790 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:27.073907 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:27.087051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:27.088462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:27.090736 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:27.094330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:27.273453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:27.284583 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2dfbdc00-876b-4b23-abcf-db61623542e1 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.215416 Jul 25 12:52:27.285657 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 512/1031] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:27 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:28.306521 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:28.307119 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:28.315176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:28.315743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:28.316902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:28.317406 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:28.475191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:28.483668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-38ba15b3-039b-4947-a8a8-d7e97d451372 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.180892 Jul 25 12:52:28.484811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 520/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:28 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:29.087314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-191cd371-e354-4e82-91ad-f59ba75d972d req-1bf6d7ab-2872-4746-9e51-a5cb3393c276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aef4fc2-5ba5-4e3b-afd3-24d50217ee37", "name": "network-vif-plugged", "status": "completed", "tag": "ca8da65d-bf70-4bd8-905a-95de16f3a998"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:29.112313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-191cd371-e354-4e82-91ad-f59ba75d972d req-1bf6d7ab-2872-4746-9e51-a5cb3393c276 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:29.113601 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-191cd371-e354-4e82-91ad-f59ba75d972d req-1bf6d7ab-2872-4746-9e51-a5cb3393c276 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:29.134226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-191cd371-e354-4e82-91ad-f59ba75d972d req-1bf6d7ab-2872-4746-9e51-a5cb3393c276 service nova] Creating event network-vif-plugged:ca8da65d-bf70-4bd8-905a-95de16f3a998 for instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 on hv-cinder-82549 Jul 25 12:52:29.149460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-191cd371-e354-4e82-91ad-f59ba75d972d req-1bf6d7ab-2872-4746-9e51-a5cb3393c276 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066336 Jul 25 12:52:29.150821 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 513/1033] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:29.508323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:29.509022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:29.516590 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:29.517287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:29.518179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:29.518794 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:29.692001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:29.700869 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7e272bfb-2bc9-4a42-9766-43424909d994 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.197141 Jul 25 12:52:29.701539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 521/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:29 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:30.724013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:30.725419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:30.731032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:30.739700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:30.740244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:30.741299 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:30.741876 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:30.930794 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:30.949416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-85edfca1-5b5a-4093-9252-c3da856d8866 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1314 microversion: 2.1 time: 0.230159 Jul 25 12:52:30.950169 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 514/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:30 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:31.970916 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:31.971671 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:31.973571 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:31.974397 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:31.982221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.983055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:31.984321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:31.984851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.133861 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:32.144347 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-01e29c76-f220-4017-8206-29c9382ccbec tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1464 microversion: 2.1 time: 0.177036 Jul 25 12:52:32.160435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 522/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:31 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:32.205836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:32.206431 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:32.219272 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.220506 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.221386 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.222933 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.272430 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:52:32.434240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cf8924cb-c139-484e-9f35-85dc65a2bde7 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 204 len: 0 microversion: 2.1 time: 0.233766 Jul 25 12:52:32.438179 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 515/1037] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:32 2022] DELETE /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:52:32.443556 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:32.444200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:32.451526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.451988 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.452836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:32.453285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:32.615453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:32.624252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ff1bda05-aff8-49a0-9935-983de50cc712 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1470 microversion: 2.1 time: 0.184635 Jul 25 12:52:32.637939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 523/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:32 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1470 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:33.652147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:33.652921 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:33.664440 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:33.665043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:33.666111 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:33.666672 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:33.842829 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:33.850692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-08a3aeaa-a422-48ca-812a-cfef448e81dc tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1470 microversion: 2.1 time: 0.203945 Jul 25 12:52:33.851276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 516/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:33 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:34.571696 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-6b6f95cf-2acf-4c99-a03d-020e022c6c49 req-7ba37145-5237-421c-9ebd-bc1bb10af564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aef4fc2-5ba5-4e3b-afd3-24d50217ee37", "name": "network-vif-deleted", "tag": "ca8da65d-bf70-4bd8-905a-95de16f3a998"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:34.590084 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-6b6f95cf-2acf-4c99-a03d-020e022c6c49 req-7ba37145-5237-421c-9ebd-bc1bb10af564 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.590982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-6b6f95cf-2acf-4c99-a03d-020e022c6c49 req-7ba37145-5237-421c-9ebd-bc1bb10af564 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.610764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-6b6f95cf-2acf-4c99-a03d-020e022c6c49 req-7ba37145-5237-421c-9ebd-bc1bb10af564 service nova] Creating event network-vif-deleted:ca8da65d-bf70-4bd8-905a-95de16f3a998 for instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 on hv-cinder-82549 Jul 25 12:52:34.619908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-6b6f95cf-2acf-4c99-a03d-020e022c6c49 req-7ba37145-5237-421c-9ebd-bc1bb10af564 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053683 Jul 25 12:52:34.622543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 524/1040] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:34.872357 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:34.873598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:34.883997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.884518 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.886596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.887580 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.902430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:34.905805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:34.915629 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.916644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.919059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.919815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.926540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:34.926985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:34.927444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lazy-loading 'fault' on Instance uuid 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:52:34.958962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7fd50001-b588-41ed-a014-0ab7ec3c61b4 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061480 Jul 25 12:52:34.959543 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 525/1041] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:52:34 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 12:52:34.980926 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b953dd2dc515426683501b4207839548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b678cb6fa6b340ae9cfc877a240ab213', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:34.989501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-df65de40-0f7e-42ad-9de7-c31145866a13 tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 200 len: 1304 microversion: 2.1 time: 0.121516 Jul 25 12:52:34.990228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 517/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:34 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:35.051817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:35.052407 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:35.059481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:35.060026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:35.060808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:35.061442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:35.089708 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:52:35.138838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:35.199193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9112c189-614b-489b-95f5-df9c4cc4645e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 204 len: 0 microversion: 2.1 time: 0.151379 Jul 25 12:52:35.199827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 526/1043] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:52:35 2022] DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:52:35.207992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:35.208605 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:35.215860 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:35.216312 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:35.217227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:35.217662 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:35.367600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:35.374997 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-9de767e7-21eb-484e-8bff-ab5093c35fc8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1674 microversion: 2.1 time: 0.170919 Jul 25 12:52:35.375556 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 518/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:35 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:36.016723 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:36.017325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] [instance: 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:36.024119 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.024561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.025323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.025752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.039108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] HTTP exception thrown: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Request method failure captured: Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 HTTP/1.1 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pH9Khv8rvfL6DhPCc5aZA2H_6dS7FRniDm_DAI2fpIKc8CWat7CLsVjS9_3clhtIQj8y4UQkQTjXF-iBpaCYla35PuNQsrQ3AjSau3mvX7T5Xd_nI8zr4GGFWTwrh7lfWk9xVKrS9IYz6SYJTwSq6lXN26iUpgYuU_hKn9f6eh8Wfk Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: b678cb6fa6b340ae9cfc877a240ab213 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-VolumesNegativeTest-1385837450 Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:52:36.040729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b678cb6fa6b340ae9cfc877a240ab213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b678cb6fa6b340ae9cfc877a240ab213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b678cb6fa6b340ae9cfc877a240ab213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b678cb6fa6b340ae9cfc877a240ab213"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-VolumesNegativeTest-1385837450 Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: b678cb6fa6b340ae9cfc877a240ab213 Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-VolumesNegativeTest-1385837450 Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-VolumesNegativeTest-1385837450-project Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: b953dd2dc515426683501b4207839548 Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-VolumesNegativeTest-1385837450-project Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. Jul 25 12:52:36.043176 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': '7aef4fc2-5ba5-4e3b-afd3-24d50217ee37'} Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:36.044171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. Jul 25 12:52:36.045758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:52:36.047217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] Returning 404 to user: Instance 7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:36.047217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c0d12205-210d-47dc-b514-c2265662483d tempest-VolumesNegativeTest-1385837450 tempest-VolumesNegativeTest-1385837450-project] 10.222.0.60 "GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37" status: 404 len: 111 microversion: 2.1 time: 0.029753 Jul 25 12:52:36.047217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 527/1045] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:36 2022] GET /compute/v2.1/servers/7aef4fc2-5ba5-4e3b-afd3-24d50217ee37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:36.396475 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:36.397859 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:36.401777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:36.406064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.406518 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.407332 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:36.407842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:36.413869 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:36.637697 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:36.646777 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f6f625f9-e3ea-48e6-b35e-2ffaf5e5aa3e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1674 microversion: 2.1 time: 0.253778 Jul 25 12:52:36.658026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 519/1046] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:36 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1674 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:37.669413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:37.670062 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:37.672516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:37.678313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:37.678836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:37.679944 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:37.680422 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:38.163510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:38.170181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c54cf296-911c-4d57-b1b0-ff6b67777ea8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1674 microversion: 2.1 time: 0.503866 Jul 25 12:52:38.170181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 528/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:37 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1674 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:38.677615 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-13df7c8c-5409-418c-99b0-cccec00dbaae req-73bdc100-4b51-42d1-84ad-d146240409b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1a64767-90c8-40a7-9019-4054dd86361e", "name": "network-vif-deleted", "tag": "b9ef35c2-defa-4487-823c-a24a086924a2"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:38.697359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-13df7c8c-5409-418c-99b0-cccec00dbaae req-73bdc100-4b51-42d1-84ad-d146240409b4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:38.700129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-13df7c8c-5409-418c-99b0-cccec00dbaae req-73bdc100-4b51-42d1-84ad-d146240409b4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:38.714181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-13df7c8c-5409-418c-99b0-cccec00dbaae req-73bdc100-4b51-42d1-84ad-d146240409b4 service nova] Creating event network-vif-deleted:b9ef35c2-defa-4487-823c-a24a086924a2 for instance f1a64767-90c8-40a7-9019-4054dd86361e on hv-cinder-82549 Jul 25 12:52:38.723303 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-13df7c8c-5409-418c-99b0-cccec00dbaae req-73bdc100-4b51-42d1-84ad-d146240409b4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049213 Jul 25 12:52:38.727934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 520/1048] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:39.201819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:39.201819 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:39.209166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:39.210011 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:39.213338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:39.214860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:39.259691 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:39.260167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:39.261152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.objects.instance [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lazy-loading 'fault' on Instance uuid f1a64767-90c8-40a7-9019-4054dd86361e {{(pid=129816) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:52:39.317606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:39.333610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4b69f398-a055-433c-b951-ce7aa9a655ec tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 200 len: 1327 microversion: 2.1 time: 0.143604 Jul 25 12:52:39.334262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 529/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:39 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 1327 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:40.358311 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:40.359934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:40.367257 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:40.367711 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:40.378340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:40.378340 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:40.389955 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e HTTP/1.1 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:52:40.391553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:52:40.393798 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'f1a64767-90c8-40a7-9019-4054dd86361e'} Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:52:40.394846 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:52:40.397602 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:52:40.399175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:52:40.399175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5d607bc5-da52-4306-8cc6-45e6bdf9cfd2 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 404 len: 111 microversion: 2.1 time: 0.039990 Jul 25 12:52:40.402412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4425c383-093c-45c1-9014-93006c01712b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '.version_select at 0x7f4c2d46ce50>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:40.407626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 521/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:40 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:52:40.425294 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4425c383-093c-45c1-9014-93006c01712b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041915671" status: 202 len: 0 microversion: 2.1 time: 0.026818 Jul 25 12:52:40.426408 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 530/1051] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Jul 25 12:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041915671 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:52:41.419073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0ee66976-689f-4358-8ae2-8215360c5229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: .version_select at 0x7f4c2d65f8b0>, body: {"keypair": {"name": "tempest-keypair-1675044258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITJhobDTf0mPCG6lyjXjOqRfAPa+OlE5a5zXPERtzLfB3s2XbW9Ij3cTOPWJeJbeGa97bFCU+HVsWrD6zdbmvI2oUkvFzz+u3tmpCZxtgfy8WIpY084C3cybcWbDVa5sw=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:41.436980 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-0ee66976-689f-4358-8ae2-8215360c5229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for project 47ad60e5634942149abd3837dc89a019. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:41.442088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-0ee66976-689f-4358-8ae2-8215360c5229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for user 9a4b1f0404e74e0e9e53e25ad92dcfed and project 47ad60e5634942149abd3837dc89a019. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:41.476590 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0ee66976-689f-4358-8ae2-8215360c5229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061365 Jul 25 12:52:41.477627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 522/1052] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:52:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:43.632909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-657102481", "imageRef": "8e07d858-99d2-4d30-9dec-280d2f88d8af", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6ac7a57-2196-497c-a362-e349cd689a47"}], "security_groups": [{"name": "tempest-securitygroup--591561110"}], "key_name": "tempest-keypair-1675044258", "user_data": "}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:43.771080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] validate_networks() for [('a6ac7a57-2196-497c-a362-e349cd689a47', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:52:44.248942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:52:44.249685 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:52:44.252125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:52:44.252569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:52:44.252979 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:52:44.267317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:44.268022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:44.268987 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:44.269772 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:44.291598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for project 47ad60e5634942149abd3837dc89a019. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:44.298338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Getting quotas for user 9a4b1f0404e74e0e9e53e25ad92dcfed and project 47ad60e5634942149abd3837dc89a019. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:44.322621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:52:44.326218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e07d858-99d2-4d30-9dec-280d2f88d8af',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:52:44.384737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a78ae412-7613-45e5-9d01-ead63232d30f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.757667 Jul 25 12:52:44.386145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 531/1053] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:52:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 12:52:44.397622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d8e52083-a196-442b-8cc2-310aef742f37 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:44.398287 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d8e52083-a196-442b-8cc2-310aef742f37 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:44.473138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d8e52083-a196-442b-8cc2-310aef742f37 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:44.482796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d8e52083-a196-442b-8cc2-310aef742f37 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1237 microversion: 2.1 time: 0.089584 Jul 25 12:52:44.483724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 523/1054] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:44 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:52:45.514166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:45.515261 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:45.524177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:45.524955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:45.525995 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:45.526625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:45.660906 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:45.671376 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1dc101a4-fff1-4727-aff2-57965cec82a8 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1233 microversion: 2.1 time: 0.161886 Jul 25 12:52:45.671967 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 532/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:45 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1233 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:46.693818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:46.695444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:46.704149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:46.704968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:46.705976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:46.706742 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:46.824789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:46.832476 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cec1c117-74fe-4563-8d01-bad2b1693b66 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1289 microversion: 2.1 time: 0.143144 Jul 25 12:52:46.839149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 524/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:46 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1289 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:47.864022 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:47.865232 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:47.874336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:47.875064 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.876024 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:47.876610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:47.985706 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:48.002279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-988df48c-9b23-4ebe-9e38-805688f6e1ca tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1289 microversion: 2.1 time: 0.143571 Jul 25 12:52:48.004107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 533/1057] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:47 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:49.028902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:49.029519 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:49.042270 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:49.043247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:49.044308 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:49.045129 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:49.203290 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:49.217690 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f9e53b02-509c-43c3-b2ee-d27f8202153f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1297 microversion: 2.1 time: 0.194229 Jul 25 12:52:49.220591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 525/1058] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:49 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:50.249071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:50.250158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:50.261403 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:50.262241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:50.264181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:50.269605 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:50.644646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:50.653341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-365cea98-1277-4358-95b2-bc80991fb82e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.410569 Jul 25 12:52:50.654265 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 534/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:50 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:50.801145 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-94764a5f-2316-41e1-a470-a65b88b346f7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Action: 'create', calling method: .version_select at 0x7f4c2d2981f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1793860161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR5fpsRiBn1LMAoWZQFmpuleMsDALy/wHMpMNASoSRSjX6aUHualAau49UeCbT/O+L8Kh5iervmznXiXaMk6juYkuu3AXx0DWhEI0VvOdgfBhJYhVKVijr58EK5yW6nPQ=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:50.821864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-94764a5f-2316-41e1-a470-a65b88b346f7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Getting quotas for project b7a69b02cd124acdb14727ea0711c1f8. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:52:50.826744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-94764a5f-2316-41e1-a470-a65b88b346f7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Getting quotas for user 42b64d8fffbc4a0fa171099d5db580a0 and project b7a69b02cd124acdb14727ea0711c1f8. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:52:50.860546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-94764a5f-2316-41e1-a470-a65b88b346f7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.315963 Jul 25 12:52:50.861360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 526/1060] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:52:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:51.294557 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-743a97a4-2410-4a6b-9963-f383eeca615d req-2a470ec0-2428-427f-ab5e-0007175f3612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83515a0-0c29-4bf7-9eda-bf729d960c59", "tag": "a258b775-e540-4f5e-b274-4a5be27a409a"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:52:51.314250 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-743a97a4-2410-4a6b-9963-f383eeca615d req-2a470ec0-2428-427f-ab5e-0007175f3612 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.315877 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-743a97a4-2410-4a6b-9963-f383eeca615d req-2a470ec0-2428-427f-ab5e-0007175f3612 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.340759 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-743a97a4-2410-4a6b-9963-f383eeca615d req-2a470ec0-2428-427f-ab5e-0007175f3612 service nova] Creating event network-changed:a258b775-e540-4f5e-b274-4a5be27a409a for instance a83515a0-0c29-4bf7-9eda-bf729d960c59 on hv-cinder-82549 Jul 25 12:52:51.354018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-743a97a4-2410-4a6b-9963-f383eeca615d req-2a470ec0-2428-427f-ab5e-0007175f3612 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065111 Jul 25 12:52:51.355205 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 535/1061] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:52:51.678291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:51.678891 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:51.688293 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.688736 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.691511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:51.692336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:51.908554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:51.918862 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-0bd3b2e1-e144-447a-9c77-4450439932e9 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.245414 Jul 25 12:52:51.919680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 527/1062] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:51 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:52.941217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:52.941896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:52.949454 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:52.949899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:52.950704 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:52.951134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:53.104754 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:53.119117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-2dd3fd5b-d7fd-4d7d-a780-539e0a2d5877 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.181996 Jul 25 12:52:53.121862 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 536/1063] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:52 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:54.144221 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:54.144852 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:54.155680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:54.156139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:54.162771 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:54.163232 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:54.358642 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:54.372838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3ddcbff9-0ecf-41ac-9105-dbf852aaf03a tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.232988 Jul 25 12:52:54.398415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 528/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:54 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:55.399713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:55.400312 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:55.403234 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:55.404102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:55.410096 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.410538 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.411298 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:55.411726 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:55.550420 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:55.559390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4308d5af-e95f-442f-affa-c791fd739cac tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.162706 Jul 25 12:52:55.559390 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 537/1065] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:55 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:56.579545 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:56.580239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:56.588707 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:56.589388 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:56.590508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:56.591160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:56.722553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:56.732381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-71e187fe-37cf-46e2-bd47-b4832f824770 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.156743 Jul 25 12:52:56.732967 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 529/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:56 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:57.753649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:57.754208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:57.760692 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.761138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.761895 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:57.762361 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:57.892044 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:57.899512 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b8e741b1-9d07-4759-ad96-4097cf87f957 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.149807 Jul 25 12:52:57.900076 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 538/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:57 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:52:58.254285 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:52:58.254812 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:52:58.920712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:52:58.921321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:52:58.927865 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:58.928306 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:58.929067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:52:58.929500 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:52:59.072990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:52:59.081114 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c3b7ae28-1bf9-41ab-ac66-7cfada065883 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.164359 Jul 25 12:52:59.081874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 530/1068] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:52:58 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:00.102178 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:00.102938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:00.110128 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:00.110598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:00.111351 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:00.111777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:00.252452 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:00.261362 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8753eef4-bd91-49cb-8ccc-e518ab47ffb7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.163656 Jul 25 12:53:00.262962 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 539/1069] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:00 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:01.284206 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:01.284839 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:01.287181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=10 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:01.292656 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:01.293105 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:01.293885 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:01.294352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:01.435258 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:01.442832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-174450a5-688e-4a23-9f9f-2bcea63b4e50 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.162633 Jul 25 12:53:01.443401 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 531/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:01 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:02.465779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:02.466611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:02.473299 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.473738 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.474595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:02.475133 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:02.619745 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:02.632449 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-69362ed1-edde-48ee-a9d5-849a0afb4229 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.170546 Jul 25 12:53:02.633142 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 540/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:02 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:03.654005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:03.654595 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:03.661057 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.661501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.662283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:03.662718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:03.805740 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:03.813743 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-836737c5-6a30-42f5-8c6e-c9ad46ab4525 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.163598 Jul 25 12:53:03.814342 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 532/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:03 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:04.834122 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:04.834739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:04.841419 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.843050 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.843838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:04.844277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:04.988907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:04.996430 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d1954dc1-4f1e-4d49-aeee-35e4ee4e3676 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.166327 Jul 25 12:53:04.997049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 541/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:04 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:06.018446 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:06.019062 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:06.025730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:06.026229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:06.027012 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:06.027450 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:06.190452 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:06.198380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-da21620d-b842-4a78-ae0c-7276c8f43266 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.183605 Jul 25 12:53:06.199018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 533/1074] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:06 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:07.220716 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:07.221399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:07.228023 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:07.228481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.229240 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:07.229672 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:07.232457 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:07.634215 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:07.642126 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-665e2e1f-ea0f-4819-aa6c-97641092ec33 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.425390 Jul 25 12:53:07.642693 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 542/1075] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:07 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:08.186824 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-4b57a04d-9197-43c3-86b0-9cb1841495a2 req-e540285a-82fa-46f5-bad5-d5c67b7cd281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83515a0-0c29-4bf7-9eda-bf729d960c59", "name": "network-vif-plugged", "status": "completed", "tag": "a258b775-e540-4f5e-b274-4a5be27a409a"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:08.193079 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:08.199288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-4b57a04d-9197-43c3-86b0-9cb1841495a2 req-e540285a-82fa-46f5-bad5-d5c67b7cd281 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.199723 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-4b57a04d-9197-43c3-86b0-9cb1841495a2 req-e540285a-82fa-46f5-bad5-d5c67b7cd281 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.205013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=64 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:08.213566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-4b57a04d-9197-43c3-86b0-9cb1841495a2 req-e540285a-82fa-46f5-bad5-d5c67b7cd281 service nova] Creating event network-vif-plugged:a258b775-e540-4f5e-b274-4a5be27a409a for instance a83515a0-0c29-4bf7-9eda-bf729d960c59 on hv-cinder-82549 Jul 25 12:53:08.219517 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-4b57a04d-9197-43c3-86b0-9cb1841495a2 req-e540285a-82fa-46f5-bad5-d5c67b7cd281 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036442 Jul 25 12:53:08.220130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 534/1076] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:53:08.663767 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:08.664352 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:08.666631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:08.671867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.672307 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.673071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:08.673500 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:08.816606 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:08.824051 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b50bc5bb-6d40-4b83-bb34-ce607de4f17e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.164113 Jul 25 12:53:08.824595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 543/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:08 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:09.846268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:09.847113 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:09.853429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.854426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.855139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:09.855569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:09.999781 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:10.013380 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5e764827-61de-4320-ab3f-110b77420d53 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1362 microversion: 2.1 time: 0.172564 Jul 25 12:53:10.014330 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 535/1078] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:09 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:11.037596 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:11.038224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:11.044700 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.045127 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:11.046703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.047134 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:11.177286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:11.185040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-a75b3d6d-ae11-4a9a-bfe0-ce0e75429809 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1548 microversion: 2.1 time: 0.151362 Jul 25 12:53:11.185544 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 544/1079] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:11 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:11.206140 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:11.206704 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:11.213132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.213579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:11.214374 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:11.214808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:11.293390 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a0b091ab-6779-457e-9986-b79fd0ad6f63 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091697 Jul 25 12:53:11.294005 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 536/1080] 10.222.0.60 () {58 vars in 1275 bytes} [Mon Jul 25 12:53:11 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:12.366111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-7f9d4bd3-baf2-459a-8789-9bd6c4b6cb79 req-9b54d14a-1946-4fb0-945f-04242c253016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83515a0-0c29-4bf7-9eda-bf729d960c59", "tag": "a258b775-e540-4f5e-b274-4a5be27a409a"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:12.376145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-7f9d4bd3-baf2-459a-8789-9bd6c4b6cb79 req-9b54d14a-1946-4fb0-945f-04242c253016 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:12.376591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-7f9d4bd3-baf2-459a-8789-9bd6c4b6cb79 req-9b54d14a-1946-4fb0-945f-04242c253016 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:12.388020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-7f9d4bd3-baf2-459a-8789-9bd6c4b6cb79 req-9b54d14a-1946-4fb0-945f-04242c253016 service nova] Creating event network-changed:a258b775-e540-4f5e-b274-4a5be27a409a for instance a83515a0-0c29-4bf7-9eda-bf729d960c59 on hv-cinder-82549 Jul 25 12:53:12.393684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-7f9d4bd3-baf2-459a-8789-9bd6c4b6cb79 req-9b54d14a-1946-4fb0-945f-04242c253016 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152939 Jul 25 12:53:12.395027 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 545/1081] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:23.403337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=5 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:23.404079 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=11 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:23.408103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-327374318", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1793860161", "security_groups": [{"name": "tempest-secgroup-smoke-1051905861"}], "networks": [{"uuid": "e5eafa79-daa3-4f44-bfa9-6122070d86ba"}], "block_device_mapping_v2": [{"uuid": "2e09008d-0512-4a93-89b3-861f81e7c676", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:23.525797 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] validate_networks() for [('e5eafa79-daa3-4f44-bfa9-6122070d86ba', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:53:24.005900 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:53:24.006346 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:53:24.006817 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:53:24.007224 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:53:24.007632 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:53:24.016725 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:24.017163 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:24.017981 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:24.018419 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:24.035853 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Getting quotas for project b7a69b02cd124acdb14727ea0711c1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:53:24.039821 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Getting quotas for user 42b64d8fffbc4a0fa171099d5db580a0 and project b7a69b02cd124acdb14727ea0711c1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:53:24.096627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:53:24.098720 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e09008d-0512-4a93-89b3-861f81e7c676',volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:53:24.236965 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-909a7d38-f38f-472c-812e-3dca954910fa tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835032 Jul 25 12:53:24.237622 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 537/1082] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:53:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:53:24.246377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:24.247576 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=19 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:24.251950 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-30875e84-0fb5-4f7f-8158-b097fecc4ab1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:24.252671 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-30875e84-0fb5-4f7f-8158-b097fecc4ab1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:24.313121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-30875e84-0fb5-4f7f-8158-b097fecc4ab1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:24.320177 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-30875e84-0fb5-4f7f-8158-b097fecc4ab1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1088 microversion: 2.1 time: 0.075414 Jul 25 12:53:24.320755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 546/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:24 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:25.341050 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:25.341756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:25.349198 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:25.349648 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:25.351088 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:25.351522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:25.421769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:25.430435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-16739e5d-a5dd-4765-b08d-db00b32fdd28 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1204 microversion: 2.1 time: 0.093691 Jul 25 12:53:25.431018 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 538/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:25 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:26.451389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:26.452115 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:26.461016 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:26.461481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:26.462277 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:26.462780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:26.667133 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:26.675581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ca46dc47-45d4-4de8-b4dd-89a0b387865c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.228094 Jul 25 12:53:26.676165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 547/1085] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:26 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:26.793255 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-dfac0fd3-190d-4536-a0e8-124a377c7ae9 req-d526a8b7-1cf5-4852-b2dd-f9cd9e80f392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:26.815848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-dfac0fd3-190d-4536-a0e8-124a377c7ae9 req-d526a8b7-1cf5-4852-b2dd-f9cd9e80f392 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:26.816284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-dfac0fd3-190d-4536-a0e8-124a377c7ae9 req-d526a8b7-1cf5-4852-b2dd-f9cd9e80f392 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:26.830123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-dfac0fd3-190d-4536-a0e8-124a377c7ae9 req-d526a8b7-1cf5-4852-b2dd-f9cd9e80f392 service nova] Creating event network-changed:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:53:26.835381 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-dfac0fd3-190d-4536-a0e8-124a377c7ae9 req-d526a8b7-1cf5-4852-b2dd-f9cd9e80f392 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052828 Jul 25 12:53:26.836832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 539/1086] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:53:27.698318 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:27.698929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:27.705536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:27.706019 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:27.706785 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:27.707208 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:27.842259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:27.850108 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4e183e7f-8efb-4db8-99bb-f46f25b39856 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.156583 Jul 25 12:53:27.850684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 548/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:27 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:28.871888 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:28.872576 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:28.878906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:28.879349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:28.880116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:28.880542 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:29.019818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:29.027426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f8699130-f169-4c9b-b534-f5eab4cb4dc8 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.160292 Jul 25 12:53:29.027989 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 540/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:28 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:30.049089 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:30.049677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:30.056434 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:30.056886 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:30.057668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:30.058130 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:30.206278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:30.215630 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ec60f4ad-d990-4a30-9cda-4c2d9333fb70 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.170949 Jul 25 12:53:30.216211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 549/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:30 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:31.236424 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:31.237023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:31.243587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:31.244022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:31.244957 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:31.245387 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:31.383673 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:31.391510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d98c0473-69ac-41f8-a166-43c268cafcb2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.159231 Jul 25 12:53:31.392607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 541/1090] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:31 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:32.412655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:32.413255 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:32.419899 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:32.420335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:32.421099 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:32.421531 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:32.560549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:32.568715 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6fd25dde-1774-4f1b-b9c8-3bf28fc5f908 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.159871 Jul 25 12:53:32.569292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 550/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:32 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:33.589483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:33.590279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:33.597748 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.598216 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:33.598987 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:33.599418 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:33.742100 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:33.750071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5ab7f4e8-0b89-41aa-8f28-8fc2c7785f25 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.164495 Jul 25 12:53:33.750924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 542/1092] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:33 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:34.773115 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:34.773765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:34.776316 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:34.782211 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:34.783235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:34.784039 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:34.784501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:34.917468 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:34.925136 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d311c20e-7f52-4c3c-80c6-a0b880d00147 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.155827 Jul 25 12:53:34.925712 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 551/1093] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:34 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:35.945529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:35.946147 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:35.948115 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:35.948773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:35.955109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.955557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:35.956319 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:35.956744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:36.093674 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:36.101833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1b5d6bec-34cd-471e-8f7a-ff481cd49199 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.160314 Jul 25 12:53:36.102443 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 543/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:35 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:37.123556 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:37.124163 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:37.131421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:37.131860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:37.132628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:37.133058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:37.270191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:37.277774 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-08dc9b3d-df11-462a-bfda-00b538ea7f04 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.158110 Jul 25 12:53:37.278373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 552/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:37 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:38.298630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:38.299240 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:38.305830 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:38.306311 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:38.307110 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:38.307538 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:38.343693 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-4004042f-13dd-4fa3-b0cc-8371827aef4c req-03614174-2857-4060-8b72-2d94df47451a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "name": "network-vif-plugged", "status": "completed", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:38.355187 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-4004042f-13dd-4fa3-b0cc-8371827aef4c req-03614174-2857-4060-8b72-2d94df47451a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:38.355624 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-4004042f-13dd-4fa3-b0cc-8371827aef4c req-03614174-2857-4060-8b72-2d94df47451a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:38.367764 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-4004042f-13dd-4fa3-b0cc-8371827aef4c req-03614174-2857-4060-8b72-2d94df47451a service nova] Creating event network-vif-plugged:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:53:38.372912 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-4004042f-13dd-4fa3-b0cc-8371827aef4c req-03614174-2857-4060-8b72-2d94df47451a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033052 Jul 25 12:53:38.373520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 553/1096] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:53:38.468457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:38.476304 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2d962c7f-b820-4348-9e9d-b5fab762715c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.181433 Jul 25 12:53:38.476887 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 544/1097] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:38 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:39.497846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:39.498503 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:39.504923 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:39.505371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:39.506180 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:39.506617 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:39.650821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:39.659004 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-49f96bc4-2dea-4923-a254-0318dc40f673 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1260 microversion: 2.1 time: 0.165922 Jul 25 12:53:39.659584 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 554/1098] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:39 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:40.680913 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:40.681531 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:40.688183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.688633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:40.689416 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.689845 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:40.832802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:40.840511 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-95b330de-6070-4754-a271-3b8a4ebef8e5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1445 microversion: 2.1 time: 0.163215 Jul 25 12:53:40.841089 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 545/1099] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:40 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:40.860953 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:53:40.861554 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:53:40.868123 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.868565 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:40.869325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:40.869751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:41.006063 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:53:41.013741 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-da29ea60-d54b-4792-bc89-bb0feca818ea tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1445 microversion: 2.1 time: 0.156936 Jul 25 12:53:41.014334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 555/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:53:40 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:53:43.056652 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-b2512c2a-2595-44fb-843b-4f58e6e7f162 req-a7b3a189-bf99-4c1b-aabc-5a46fc5a00e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:53:43.067471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-b2512c2a-2595-44fb-843b-4f58e6e7f162 req-a7b3a189-bf99-4c1b-aabc-5a46fc5a00e6 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:53:43.067933 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-b2512c2a-2595-44fb-843b-4f58e6e7f162 req-a7b3a189-bf99-4c1b-aabc-5a46fc5a00e6 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:53:43.079644 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-b2512c2a-2595-44fb-843b-4f58e6e7f162 req-a7b3a189-bf99-4c1b-aabc-5a46fc5a00e6 service nova] Creating event network-changed:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:53:43.084807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-b2512c2a-2595-44fb-843b-4f58e6e7f162 req-a7b3a189-bf99-4c1b-aabc-5a46fc5a00e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031881 Jul 25 12:53:43.085474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 546/1101] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:54:27.276955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:27.277564 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:27.279789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=22 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:27.280595 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=50 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:27.286955 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:27.287396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:27.288165 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:27.288593 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:27.313813 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-fd6c12bd-9abe-4b3f-b581-6e84c6a5babf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/ips" status: 200 len: 145 microversion: 2.1 time: 0.040014 Jul 25 12:54:27.314439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 556/1102] 10.222.0.60 () {58 vars in 1248 bytes} [Mon Jul 25 12:54:27 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:28.644564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:28.645411 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=48 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:28.650161 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e51e813-6aec-4394-bc4d-15e57b81160b"}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:28.652557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:28.660118 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:28.660564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:28.661338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:28.661772 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:28.929315 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bae376b8-769b-4ccd-88fd-71a6b3d4e4cf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286279 Jul 25 12:54:28.929952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 547/1103] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:54:28 2022] POST /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:36.468674 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:36.471870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:36.478840 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.479291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.480061 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.480495 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.513461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e4cdcdca-e5d6-47ae-a9b1-a9fa611df45c tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049349 Jul 25 12:54:36.514058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 557/1104] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:54:36 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:36.526286 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:36.526882 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:36.533753 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.534228 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.535002 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:36.535432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:36.563721 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-2cd8c04f-c78d-485a-8d48-08caaf2f63a5 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b" status: 200 len: 194 microversion: 2.1 time: 0.042133 Jul 25 12:54:36.564643 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 548/1105] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Jul 25 12:54:36 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:37.912168 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c653fe7b-a92e-4627-81ea-fad78a14c6f7"}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:37.914686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:37.921464 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.921924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:37.922713 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:37.923146 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:38.351054 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-3d484bd7-b816-44a3-a57e-1bc5826cc7ee tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "POST /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442686 Jul 25 12:54:38.351702 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 558/1106] 10.222.0.60 () {60 vars in 1323 bytes} [Mon Jul 25 12:54:37 2022] POST /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:45.888375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:45.890669 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:45.900037 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:45.900806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:45.902148 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:45.902886 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:45.935699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3342e1d9-8c11-4513-8496-28bc83338675 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051228 Jul 25 12:54:45.936260 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 549/1107] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:54:45 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:46.077829 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:46.079020 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:46.085272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.085714 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.086511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.086938 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.118811 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4af49aa3-9c94-4d60-9909-dbe86072a281 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b" status: 200 len: 194 microversion: 2.1 time: 0.045725 Jul 25 12:54:46.119413 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 559/1108] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Jul 25 12:54:46 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:46.129827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:46.130355 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:46.136417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.136923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.137699 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:46.138194 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:46.277167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lazy-loading 'services' on Instance uuid a83515a0-0c29-4bf7-9eda-bf729d960c59 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:54:46.352614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-80ce8e36-0890-4dd3-9b88-ffcef052fb68 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b" status: 202 len: 0 microversion: 2.1 time: 0.226590 Jul 25 12:54:46.353229 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 550/1109] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:54:46 2022] DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/7e51e813-6aec-4394-bc4d-15e57b81160b => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:54:48.531761 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:48.532326 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:48.538855 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.539297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.540059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.540489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.570641 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e0e5fbef-613e-4f9e-9edb-0ed0994ff8f7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/c653fe7b-a92e-4627-81ea-fad78a14c6f7" status: 200 len: 194 microversion: 2.1 time: 0.042751 Jul 25 12:54:48.571239 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 560/1110] 10.222.0.60 () {58 vars in 1413 bytes} [Mon Jul 25 12:54:48 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/c653fe7b-a92e-4627-81ea-fad78a14c6f7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:48.582893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:48.583468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:48.589722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.590226 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.590995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:48.591437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:48.673321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lazy-loading 'services' on Instance uuid a83515a0-0c29-4bf7-9eda-bf729d960c59 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:54:48.746658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f44dd263-dd84-4982-96e4-509560f32bd3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/c653fe7b-a92e-4627-81ea-fad78a14c6f7" status: 202 len: 0 microversion: 2.1 time: 0.168386 Jul 25 12:54:48.747283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 551/1111] 10.222.0.60 () {58 vars in 1416 bytes} [Mon Jul 25 12:54:48 2022] DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments/c653fe7b-a92e-4627-81ea-fad78a14c6f7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:54:49.925561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:49.927870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:49.934459 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:49.934908 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:49.935684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:49.936121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:49.965732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ce3bdf56-6a1f-48be-9ed1-cd062d5557d1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044648 Jul 25 12:54:49.966337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 561/1112] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:54:49 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:54:50.081072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:50.083276 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:50.090130 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.090578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.091353 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.091786 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.126929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bb5e175d-eb59-4bbf-9330-576934cdc46b tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050191 Jul 25 12:54:50.127498 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 552/1113] 10.222.0.60 () {58 vars in 1302 bytes} [Mon Jul 25 12:54:50 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 12:54:50.189426 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:50.189945 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:50.196046 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.196527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.197286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.197723 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.225245 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:54:50.309586 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-990bca66-336a-448d-be87-e5409f1ae3e1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 204 len: 0 microversion: 2.1 time: 0.123658 Jul 25 12:54:50.310241 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 562/1114] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:54:50 2022] DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:54:50.319352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:50.319352 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:50.325313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.325753 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.326569 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:50.326995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:50.467792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:50.475952 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-971e4ada-b381-4202-9053-a26b74bdcf26 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1672 microversion: 2.1 time: 0.161253 Jul 25 12:54:50.476533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 553/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:50 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:51.499380 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:51.500002 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:51.506838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.507279 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:51.508056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:51.508492 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:51.658435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:51.666438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ad4ba6ba-7a9d-443c-ae71-d4c51b65d9cc tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1672 microversion: 2.1 time: 0.172205 Jul 25 12:54:51.667012 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 563/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:51 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:52.689637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:52.689637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:52.696086 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.696533 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.697302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:52.697730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:52.833809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4b1f0404e74e0e9e53e25ad92dcfed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47ad60e5634942149abd3837dc89a019', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:54:52.844998 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cf0f40ef-1592-4fa1-872b-1cdedd9d8aaf tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 200 len: 1672 microversion: 2.1 time: 0.160370 Jul 25 12:54:52.845597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 554/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:52 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:54:53.337498 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-5b975775-c8de-4ed8-89b9-3658460428af req-8f08bd40-5196-49d5-b974-9c093af539c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83515a0-0c29-4bf7-9eda-bf729d960c59", "name": "network-vif-deleted", "tag": "a258b775-e540-4f5e-b274-4a5be27a409a"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:54:53.354221 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5b975775-c8de-4ed8-89b9-3658460428af req-8f08bd40-5196-49d5-b974-9c093af539c1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.354665 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-5b975775-c8de-4ed8-89b9-3658460428af req-8f08bd40-5196-49d5-b974-9c093af539c1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.367816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-5b975775-c8de-4ed8-89b9-3658460428af req-8f08bd40-5196-49d5-b974-9c093af539c1 service nova] Creating event network-vif-deleted:a258b775-e540-4f5e-b274-4a5be27a409a for instance a83515a0-0c29-4bf7-9eda-bf729d960c59 on hv-cinder-82549 Jul 25 12:54:53.373809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-5b975775-c8de-4ed8-89b9-3658460428af req-8f08bd40-5196-49d5-b974-9c093af539c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039806 Jul 25 12:54:53.375972 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 564/1118] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:54:53.867483 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:53.868723 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:53.877053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.877497 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.878343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:53.878782 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:53.893183 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 HTTP/1.1 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:54:53.895165 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:53.896682 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'a83515a0-0c29-4bf7-9eda-bf729d960c59'} Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:54:53.900858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:53.902354 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:53.903566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:54:53.903566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3bac4fd4-3277-4130-bedd-ed32dc6b578e tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 404 len: 111 microversion: 2.1 time: 0.033592 Jul 25 12:54:53.903566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 555/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:53 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 12:54:53.907412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5d0bc3f9-4eb4-4ed3-9521-dc5452cf8be1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '.version_select at 0x7f4c2d4b8700>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:53.931200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5d0bc3f9-4eb4-4ed3-9521-dc5452cf8be1 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675044258" status: 202 len: 0 microversion: 2.1 time: 0.028441 Jul 25 12:54:53.931924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 565/1120] 10.222.0.60 () {58 vars in 1221 bytes} [Mon Jul 25 12:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675044258 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:54:56.879174 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:56.879722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:56.887073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.887073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.887637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.888066 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.902384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 HTTP/1.1 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:54:56.903924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.905587 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'a83515a0-0c29-4bf7-9eda-bf729d960c59'} Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:54:56.906547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.908213 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.909789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:54:56.909789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c416e226-be67-42ce-951a-c4708c1161c7 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 404 len: 111 microversion: 2.1 time: 0.030662 Jul 25 12:54:56.909789 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 556/1121] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:54:56 2022] DELETE /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:54:56.916421 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:56.917181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: a83515a0-0c29-4bf7-9eda-bf729d960c59] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:56.926970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.927410 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.928197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:56.928626 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:56.942743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 HTTP/1.1 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:54:56.944476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.946959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'a83515a0-0c29-4bf7-9eda-bf729d960c59'} Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:54:56.948678 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. Jul 25 12:54:56.951442 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:56.954304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance a83515a0-0c29-4bf7-9eda-bf729d960c59 could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:54:56.954304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7979d13e-dff5-49b2-b61a-f5b2ec49a989 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59" status: 404 len: 111 microversion: 2.1 time: 0.035236 Jul 25 12:54:56.954304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 566/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:56 2022] GET /compute/v2.1/servers/a83515a0-0c29-4bf7-9eda-bf729d960c59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:54:58.089993 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:58.090527 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:58.097532 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.097995 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.098763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.099193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.115112 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e HTTP/1.1 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:54:58.116776 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.119019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'f1a64767-90c8-40a7-9019-4054dd86361e'} Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:54:58.120407 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.122827 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.125013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:54:58.125013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6ea32657-674d-41f1-b5f4-15411ddf4b0f tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 404 len: 111 microversion: 2.1 time: 0.032005 Jul 25 12:54:58.125013 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 557/1123] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:54:58 2022] DELETE /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:54:58.130311 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:54:58.131489 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] [instance: f1a64767-90c8-40a7-9019-4054dd86361e] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:54:58.136798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:58.141524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.142018 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.142801 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:54:58.143236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:54:58.146680 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:58.161379 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] HTTP exception thrown: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Request method failure captured: Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e HTTP/1.1 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pDp7UvJA9eDx2bOVLE6vUIgu8l-wRBxWVkZkN4rMr8-DrXPtSf6iVYNxpY3vrjS0sy-CJfNyNvxcSyXTzU4APxgsQGXHebrSG7GKw39ENNFo4ObMluPuV0WnbWFSBAwpGIXYbIsaq8zn9gdjjcgsbbBidSPLYUs6ACnfpWFfb8hAB0 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:54:58.163047 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47ad60e5634942149abd3837dc89a019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47ad60e5634942149abd3837dc89a019"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: 47ad60e5634942149abd3837dc89a019 Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-AttachVolumeTestJSON-182523797 Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 9a4b1f0404e74e0e9e53e25ad92dcfed Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-AttachVolumeTestJSON-182523797-project Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.164694 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'f1a64767-90c8-40a7-9019-4054dd86361e'} Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:54:58.165610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. Jul 25 12:54:58.167151 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:54:58.168304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] Returning 404 to user: Instance f1a64767-90c8-40a7-9019-4054dd86361e could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:54:58.168304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1822d5c6-128d-455c-a7cc-943cb39e7bf3 tempest-AttachVolumeTestJSON-182523797 tempest-AttachVolumeTestJSON-182523797-project] 10.222.0.60 "GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e" status: 404 len: 111 microversion: 2.1 time: 0.040645 Jul 25 12:54:58.168304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 567/1124] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:54:58 2022] GET /compute/v2.1/servers/f1a64767-90c8-40a7-9019-4054dd86361e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:55:58.558049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=22 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:58.559295 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:58.574479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:55:58.574479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:58.574479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.574479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.575122 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.575122 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.597731 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.objects.instance [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lazy-loading 'flavor' on Instance uuid 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 {{(pid=129815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 12:55:58.669703 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-dadc03c3-419c-4aa6-86f8-52e9cfe1d41f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "POST /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.113564 Jul 25 12:55:58.670329 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 558/1125] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:55:58 2022] POST /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:55:58.679725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:58.680335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:58.682909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:58.688463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.688909 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.689729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:58.690181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:58.823561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:55:58.831621 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d8e288e9-dda4-47b6-8ba0-672206b92360 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.156230 Jul 25 12:55:58.832116 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 568/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:58 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:55:59.854502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:55:59.855127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:55:59.861300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.861719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.862775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:55:59.863211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:55:59.995149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:00.002816 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4a8d8867-2060-482d-b9d6-148892580a43 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.153204 Jul 25 12:56:00.003377 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 559/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:55:59 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:01.024779 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:01.025396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:01.032915 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.034086 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.035058 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:01.035501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:01.174627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:01.182197 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b5fc6b30-8c4a-4e7d-a9e0-524348fe55c2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.161425 Jul 25 12:56:01.182791 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 569/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:01 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:02.207752 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:02.208858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:02.219015 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.219736 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.221494 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:02.222234 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:02.371778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:02.379596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5d3ffaba-cc6c-417e-abbf-437e3301c9b5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.178389 Jul 25 12:56:02.380170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 560/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:02 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:03.404612 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:03.405191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:03.413701 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.414195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.414959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:03.415384 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:03.585286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:03.594881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-1edfbcdb-9298-4c74-9410-e1b39ad7987f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.194769 Jul 25 12:56:03.596192 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 570/1130] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:03 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:04.616676 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:04.617305 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:04.625100 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.625774 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:04.627185 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:04.627627 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:05.012733 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:05.020889 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-b665f500-3431-44ab-a2f9-c6c9bd11ca7c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.408036 Jul 25 12:56:05.021474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 561/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:04 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:06.041816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:06.042454 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:06.048896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.049337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.050125 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:06.050561 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:06.191112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:06.198609 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b0225413-b5ca-4370-88c8-3dd327c90db1 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.160687 Jul 25 12:56:06.199171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 571/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:06 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:07.219983 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:07.221170 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:07.227596 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:07.228034 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:07.228783 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:07.229210 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:07.363203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:07.371614 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1b25dd57-40ba-4df0-8519-55bb361055e7 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.155300 Jul 25 12:56:07.372256 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 562/1133] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:07 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:08.394601 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:08.395224 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:08.401710 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.402189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.402957 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:08.403392 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:08.538107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:08.545769 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-353f0aeb-1a07-405f-af58-b66367333942 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.156594 Jul 25 12:56:08.546371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 572/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:08 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:09.567850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:09.568460 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:09.575152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:09.575618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:09.576429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:09.576868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:09.712393 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:09.720975 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-08a668d6-9030-47dc-b044-85bc7939c53f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.156990 Jul 25 12:56:09.721550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 563/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:09 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:10.742954 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:10.743583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:10.750292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.750743 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.752162 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:10.752598 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:10.889476 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:10.897056 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f1371e8d-0699-4356-9df0-8b0b05c67399 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.158000 Jul 25 12:56:10.897630 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 573/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:10 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:11.918917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:11.919606 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:11.927024 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:11.927474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:11.928244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:11.928696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.069022 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:12.081616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4cdcbe3f-dca5-4902-b7f2-3a938ec9e099 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1570 microversion: 2.1 time: 0.163376 Jul 25 12:56:12.081616 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 564/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:11 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:12.099120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:12.099737 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.106818 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.107319 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.108152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.108579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.195435 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-23ae6c64-5297-4ee6-a59a-b39bc36d7bc3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "POST /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.100293 Jul 25 12:56:12.196236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 574/1138] 10.222.0.60 () {60 vars in 1278 bytes} [Mon Jul 25 12:56:12 2022] POST /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:56:12.204464 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:12.205638 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:12.211645 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.212090 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.212851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:12.213284 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:12.374209 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:12.385081 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-01c3d6c2-5d09-4d49-98ae-86c1982669c5 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1578 microversion: 2.1 time: 0.184500 Jul 25 12:56:12.386139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 565/1139] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:12 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:13.407432 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:13.407969 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:13.413965 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.414412 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.415154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:13.415585 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:13.543121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:13.550466 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-45ef2941-cf66-4b1c-9672-03a0e47df503 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1520 microversion: 2.1 time: 0.147558 Jul 25 12:56:13.551033 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 575/1140] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:13 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:14.571383 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:14.571994 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:14.578365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.578810 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.579618 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:14.580046 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:14.719487 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:14.727337 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5622ce4f-e925-4c75-992e-563f02f84418 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1520 microversion: 2.1 time: 0.159745 Jul 25 12:56:14.727919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 566/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:14 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:15.002109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-901d70dc-026c-4e84-880c-1d71d95fa98b req-e31006f5-7c29-4cfb-9e4d-f8da70c7eb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "name": "network-vif-unplugged", "status": "completed", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:15.012334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-901d70dc-026c-4e84-880c-1d71d95fa98b req-e31006f5-7c29-4cfb-9e4d-f8da70c7eb88 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:15.012832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-901d70dc-026c-4e84-880c-1d71d95fa98b req-e31006f5-7c29-4cfb-9e4d-f8da70c7eb88 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:15.024345 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-901d70dc-026c-4e84-880c-1d71d95fa98b req-e31006f5-7c29-4cfb-9e4d-f8da70c7eb88 service nova] Creating event network-vif-unplugged:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:56:15.029377 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-901d70dc-026c-4e84-880c-1d71d95fa98b req-e31006f5-7c29-4cfb-9e4d-f8da70c7eb88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031138 Jul 25 12:56:15.029986 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 576/1142] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:56:15.750455 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:15.751026 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:15.757501 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:15.757972 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:15.758741 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:15.759175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:15.893106 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:15.900646 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-636df90e-403e-4c97-8c11-64286e288b4f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.154177 Jul 25 12:56:15.901215 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 567/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:15 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:16.923815 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:16.924519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:16.931846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.932289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:16.933059 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:16.933511 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:17.065473 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:17.072862 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-99d5f897-310f-45dc-a30f-234d3030c839 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.153915 Jul 25 12:56:17.073415 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 577/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:16 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:18.093327 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:18.093886 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:18.100471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:18.100912 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:18.101659 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:18.102120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:18.239503 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:18.246963 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-fc44839e-bfb3-4051-831e-32cdf56fd24c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.157484 Jul 25 12:56:18.247528 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 568/1145] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:18 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:18.263044 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:56:18.263230 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:56:19.268922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:19.269527 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:19.275780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.276217 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.276963 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:19.277388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:19.404669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:19.412200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-e4f85309-4f1c-469e-bca8-b6e7bed86c38 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.147667 Jul 25 12:56:19.412847 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 578/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:19 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:20.432470 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:20.433067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:20.439693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:20.440072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:20.440819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:20.441244 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:20.569766 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:20.577064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6b21657c-8396-4603-a2f5-c8577d6060c0 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.148421 Jul 25 12:56:20.577609 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 569/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:20 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:21.598805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:21.599405 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:21.605844 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.606315 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.607090 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:21.607516 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:21.737777 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:21.745244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b9d8294a-9a9b-4483-a1bd-2e628269dc48 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.150743 Jul 25 12:56:21.745810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 579/1148] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:21 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:22.767539 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:22.768143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:22.774201 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.774629 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.775384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:22.775818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:22.908003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:22.915376 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8e4571e4-ddc5-4a44-944f-48743a6d8374 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.152507 Jul 25 12:56:22.915929 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 570/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:22 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:23.936796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:23.937348 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:23.943789 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.944236 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:23.944991 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:23.945420 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:24.074399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:24.082357 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8661ea55-34af-4d2f-aa4a-8d5c6ea91758 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.149542 Jul 25 12:56:24.082918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 580/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:23 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:25.102700 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:25.103302 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:25.109666 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.110143 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.111474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:25.111901 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:25.247916 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:25.256992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5cc6018d-a7c0-4111-a479-c6a4db497cf2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.157979 Jul 25 12:56:25.257552 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 571/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:25 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:26.283450 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:26.284078 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:26.290452 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.290898 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.291660 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:26.292092 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:26.418453 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:26.425925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-eec3bba5-00bd-4541-ac97-6c2f032228af tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.146338 Jul 25 12:56:26.426520 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 581/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:26 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:56:27.103437 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-0d864662-0cfc-46d4-9bc8-f0f068b23603 req-b257aed8-252d-4e8a-85da-a20b158e1cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "name": "network-vif-plugged", "status": "completed", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:27.113844 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0d864662-0cfc-46d4-9bc8-f0f068b23603 req-b257aed8-252d-4e8a-85da-a20b158e1cb8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:27.114314 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-0d864662-0cfc-46d4-9bc8-f0f068b23603 req-b257aed8-252d-4e8a-85da-a20b158e1cb8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:27.126009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-0d864662-0cfc-46d4-9bc8-f0f068b23603 req-b257aed8-252d-4e8a-85da-a20b158e1cb8 service nova] Creating event network-vif-plugged:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:56:27.131546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-0d864662-0cfc-46d4-9bc8-f0f068b23603 req-b257aed8-252d-4e8a-85da-a20b158e1cb8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Jul 25 12:56:27.132331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 572/1153] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:56:27.447431 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:27.448109 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:27.463805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:27.464331 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:27.465144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:27.465573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:27.600835 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:27.608257 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f5a0e9e4-e8de-4164-a62f-320a1c38a6e3 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.164793 Jul 25 12:56:27.608817 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 582/1154] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:27 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:28.631491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:28.632181 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:28.634126 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=31 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:28.639444 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.639874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.640626 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:28.641051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:28.645053 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:28.776371 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:28.784414 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-179ff639-641b-48bf-a365-744340f0293a tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1576 microversion: 2.1 time: 0.157627 Jul 25 12:56:28.784977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 573/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:28 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:29.811649 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:56:29.812252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:56:29.815317 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=33 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:29.820538 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.820980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.821736 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:56:29.822188 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:56:29.826194 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:29.960035 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:56:29.967775 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8057d743-8a36-4c9c-893f-8f8aceca6b2f tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1563 microversion: 2.1 time: 0.159963 Jul 25 12:56:29.968339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 583/1156] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:56:29 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:56:41.843761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:41.845073 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=5 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:42.042512 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-1c88e419-4edc-433f-9a86-b581cdd06a14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Action: 'create', calling method: .version_select at 0x7f4c2d65fc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1501702746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJF8RymDrTTFWQhB54sC+osi3IbKCZY0EHAH+LKmzEnQmbi3++CPEHzzxZM9C0jviyFfmwZQQ8cm7jMUHc2NzOg6qwT9KR4i3VNiNO4+tKuamFulAO8M6n3UKVmVZChsyw=="}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:56:42.058522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-1c88e419-4edc-433f-9a86-b581cdd06a14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for project c09181aee1194e42a4e88b4e37592e1c. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:56:42.062453 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-1c88e419-4edc-433f-9a86-b581cdd06a14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for user 318c288d31a74072b61ef089a028133d and project c09181aee1194e42a4e88b4e37592e1c. Resources: {'key_pairs'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:56:42.088585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-1c88e419-4edc-433f-9a86-b581cdd06a14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.253659 Jul 25 12:56:42.089191 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 574/1157] 10.222.0.60 () {60 vars in 1159 bytes} [Mon Jul 25 12:56:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:06.997321 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-407050506", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501702746", "security_groups": [{"name": "tempest-secgroup-smoke-2078993820"}], "block_device_mapping_v2": [{"uuid": "5e6c5be4-c2db-49f7-9286-d44b6db22107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99391e46-f634-4a13-8d7e-0cfa93980f7c"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:07.007304 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:07.007948 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=5 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:07.116860 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] validate_networks() for [('99391e46-f634-4a13-8d7e-0cfa93980f7c', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:57:07.602048 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:57:07.602475 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:57:07.602948 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:57:07.603350 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:57:07.603755 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:57:07.613688 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.614339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.615167 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:07.615610 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:07.633573 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:57:07.637501 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for user 318c288d31a74072b61ef089a028133d and project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:57:07.695110 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:57:07.697195 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e6c5be4-c2db-49f7-9286-d44b6db22107',volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:57:07.828730 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-73d6b3d2-a2bc-4712-a1a4-4befe52a22df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835253 Jul 25 12:57:07.829419 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 584/1158] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:57:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:57:07.840404 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-a492f8ff-30d7-4c9e-8310-08e920c580f3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:07.841043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-a492f8ff-30d7-4c9e-8310-08e920c580f3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:07.843160 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=4 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:07.843724 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:07.902320 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-a492f8ff-30d7-4c9e-8310-08e920c580f3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:07.912557 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-a492f8ff-30d7-4c9e-8310-08e920c580f3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1094 microversion: 2.1 time: 0.075914 Jul 25 12:57:07.913212 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 575/1159] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:07 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:08.934227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:08.934806 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:08.942758 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.943214 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:08.944040 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:08.944477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:09.011757 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:09.025633 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0d03b93b-ea1d-4010-8213-8b0de138cbc5 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1192 microversion: 2.1 time: 0.095338 Jul 25 12:57:09.026371 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 585/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:08 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:10.050922 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:10.051974 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:10.061530 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:10.062220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.063812 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:10.064562 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.221867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:10.229343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6e6eeddd-e84e-402f-8871-a237a67c5f19 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.184319 Jul 25 12:57:10.229934 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 576/1161] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:10 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:10.880628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-420b616a-cd43-4064-9257-5366498399ff req-b05c894e-3502-4540-a961-321a105ee28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec7a091-5227-4b72-80f6-754bd8ff366c", "tag": "d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:10.890423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-420b616a-cd43-4064-9257-5366498399ff req-b05c894e-3502-4540-a961-321a105ee28c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:10.890859 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-420b616a-cd43-4064-9257-5366498399ff req-b05c894e-3502-4540-a961-321a105ee28c service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:10.902765 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-420b616a-cd43-4064-9257-5366498399ff req-b05c894e-3502-4540-a961-321a105ee28c service nova] Creating event network-changed:d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd for instance bec7a091-5227-4b72-80f6-754bd8ff366c on hv-cinder-82549 Jul 25 12:57:10.908336 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-420b616a-cd43-4064-9257-5366498399ff req-b05c894e-3502-4540-a961-321a105ee28c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112535 Jul 25 12:57:10.908796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 586/1162] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:57:11.253172 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:11.253868 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:11.261043 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.261489 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.262278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:11.262715 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:11.409809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:11.417502 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-7c1ae7a8-df9a-46c4-8c27-623775abb7e9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.168676 Jul 25 12:57:11.418190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 577/1163] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:11 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:12.441053 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:12.441788 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:12.448579 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.449030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.449802 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:12.450265 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:12.669532 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:12.678171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5c450303-8cc1-443e-a9f4-8ed2e623d374 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.242062 Jul 25 12:57:12.678849 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 587/1164] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:12 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:13.699679 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:13.700275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:13.707333 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.707769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.708515 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:13.708940 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:13.840768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:13.849205 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-cbbd3572-52ec-44c7-bb67-ff3ebf8686ba tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.153395 Jul 25 12:57:13.849769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 578/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:13 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:14.869439 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:14.870075 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:14.876943 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.877378 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:14.878158 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:14.878613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:15.013206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:15.021145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-25368154-043f-42ae-9ba2-6a5c28eabc14 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.155218 Jul 25 12:57:15.021374 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 588/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:14 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:16.041730 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:16.042361 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:16.049447 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.049890 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.050677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:16.051108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:16.197098 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:16.204637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3db82ec3-697d-479a-9f2f-d7b4aedbdc64 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.166813 Jul 25 12:57:16.205193 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 579/1167] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:16 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:17.225739 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:17.226388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:17.232930 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:17.233386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:17.234191 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:17.234622 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:17.376416 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:17.384259 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0e1ed19b-1242-430b-9421-dac8a93daa5c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.162443 Jul 25 12:57:17.384832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 589/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:17 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:18.405167 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:18.405763 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:18.409279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:18.414685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.415120 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.415875 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:18.416331 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:18.546633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:18.554040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-bf4bd5d7-060c-4ea7-8a3f-0072ef1a8a8a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.152724 Jul 25 12:57:18.554611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 580/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:18 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:19.575334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:19.575934 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:19.578218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:19.578907 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:19.584919 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.585357 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:19.586144 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:19.586572 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:19.724980 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:19.732387 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-5b494f46-bed7-4b67-bb14-d2cf5d8fbdd7 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.160957 Jul 25 12:57:19.733007 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 590/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:19 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:20.754434 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:20.755051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:20.761404 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:20.761841 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:20.762628 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:20.763058 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:20.895471 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:20.902944 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e74d5fb9-693d-45b2-866b-ffb6694380d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.153134 Jul 25 12:57:20.903509 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 581/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:20 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:21.493842 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-8617a782-b611-48ac-8c0d-a1e2f7ac5092 req-2cf8ec1e-83ae-42f7-b911-d122a04d1977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec7a091-5227-4b72-80f6-754bd8ff366c", "name": "network-vif-plugged", "status": "completed", "tag": "d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:21.503483 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8617a782-b611-48ac-8c0d-a1e2f7ac5092 req-2cf8ec1e-83ae-42f7-b911-d122a04d1977 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.503970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-8617a782-b611-48ac-8c0d-a1e2f7ac5092 req-2cf8ec1e-83ae-42f7-b911-d122a04d1977 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.515253 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-8617a782-b611-48ac-8c0d-a1e2f7ac5092 req-2cf8ec1e-83ae-42f7-b911-d122a04d1977 service nova] Creating event network-vif-plugged:d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd for instance bec7a091-5227-4b72-80f6-754bd8ff366c on hv-cinder-82549 Jul 25 12:57:21.521130 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-8617a782-b611-48ac-8c0d-a1e2f7ac5092 req-2cf8ec1e-83ae-42f7-b911-d122a04d1977 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090176 Jul 25 12:57:21.521722 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 591/1172] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 12:57:21.924883 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:21.925611 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:21.931899 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.932343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:21.933103 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:21.933536 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:22.068754 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:22.076334 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5a44dffd-2b2c-4aa6-84b1-56ad0548d81c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.155799 Jul 25 12:57:22.076923 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 582/1173] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:21 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:23.098843 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:23.099539 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:23.105725 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:23.106199 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.106959 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:23.107389 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:23.253181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:23.260695 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-253341d1-f1f2-4749-8071-36a4690ba1df tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1266 microversion: 2.1 time: 0.167188 Jul 25 12:57:23.261273 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 592/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:23 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:24.282920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:24.283522 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:24.290069 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.290516 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:24.291278 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.291708 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:24.423364 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:24.431102 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-3d6e8405-6d77-488b-9dfd-11df22ddb1ed tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1453 microversion: 2.1 time: 0.152791 Jul 25 12:57:24.431677 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 583/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:24 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:57:24.451417 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:57:24.452042 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:57:24.459112 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.459552 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:24.460320 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:24.460827 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:24.597237 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:57:24.605807 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-004c61ba-35ae-461b-b9f8-933f8ff6d13a tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1453 microversion: 2.1 time: 0.157530 Jul 25 12:57:24.606506 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 593/1176] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:57:24 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:57:26.613773 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-cdfb7b83-dca6-4f72-9a06-8055ac0a6019 req-6ecb2718-5cae-41aa-9b22-3c58a07f4f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bec7a091-5227-4b72-80f6-754bd8ff366c", "tag": "d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:57:26.624761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-cdfb7b83-dca6-4f72-9a06-8055ac0a6019 req-6ecb2718-5cae-41aa-9b22-3c58a07f4f98 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:57:26.625268 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-cdfb7b83-dca6-4f72-9a06-8055ac0a6019 req-6ecb2718-5cae-41aa-9b22-3c58a07f4f98 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:57:26.637242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-cdfb7b83-dca6-4f72-9a06-8055ac0a6019 req-6ecb2718-5cae-41aa-9b22-3c58a07f4f98 service nova] Creating event network-changed:d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd for instance bec7a091-5227-4b72-80f6-754bd8ff366c on hv-cinder-82549 Jul 25 12:57:26.642630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-cdfb7b83-dca6-4f72-9a06-8055ac0a6019 req-6ecb2718-5cae-41aa-9b22-3c58a07f4f98 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033143 Jul 25 12:57:26.643474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 584/1177] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:57:58.304166 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:57:58.304787 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 12:57:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:58:10.169292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:10.170918 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=48 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:10.174819 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=22 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:10.177037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:10.177537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:10.178634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=50 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:10.186102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.186549 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.187329 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.188135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.189654 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-b5be5502-18a5-4447-9d9c-573e143897bd req-57666d00-cf34-48cd-b970-22fdf5aca5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:10.200152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-b5be5502-18a5-4447-9d9c-573e143897bd req-57666d00-cf34-48cd-b970-22fdf5aca5bc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.200735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-b5be5502-18a5-4447-9d9c-573e143897bd req-57666d00-cf34-48cd-b970-22fdf5aca5bc service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.212116 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-b5be5502-18a5-4447-9d9c-573e143897bd req-57666d00-cf34-48cd-b970-22fdf5aca5bc service nova] Creating event network-changed:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:58:10.215623 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:58:10.217474 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-b5be5502-18a5-4447-9d9c-573e143897bd req-57666d00-cf34-48cd-b970-22fdf5aca5bc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044784 Jul 25 12:58:10.218250 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 585/1178] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:10.308064 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7e3964c6-7e10-4115-8f27-54ab400da4ee tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 204 len: 0 microversion: 2.1 time: 0.139578 Jul 25 12:58:10.312285 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 594/1179] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:58:10 2022] DELETE /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:58:10.319150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:10.323747 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:10.332001 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.332456 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.333275 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:10.333933 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:10.472365 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:10.479698 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-60dbd676-68f5-4fb0-9b5c-97eb47767eeb tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.164980 Jul 25 12:58:10.480264 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 586/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:10 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:11.501196 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:11.501808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:11.508367 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:11.508804 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:11.509559 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:11.510010 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:11.696039 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:11.705141 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-12ed5a89-b137-4024-99cc-6534c4faf9e2 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1569 microversion: 2.1 time: 0.208248 Jul 25 12:58:11.705809 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 595/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:11 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:12.726389 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:12.727003 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:12.733726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:12.734204 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.735465 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:12.735896 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.873307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42b64d8fffbc4a0fa171099d5db580a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7a69b02cd124acdb14727ea0711c1f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:58:12.883547 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-daba371e-14ef-47d2-a5b8-a8705493c670 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 200 len: 1451 microversion: 2.1 time: 0.159645 Jul 25 12:58:12.884339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 587/1182] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:12 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:58:12.929322 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-28b2c17d-a2c4-4f78-b85c-e08c97dc1604 req-5629a855-8f5d-4367-9b37-fdf9a2d1ab5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3287c8-5a26-458c-93a0-3ae6a820f3e6", "name": "network-vif-deleted", "tag": "45398252-0703-42ee-96b5-f0a29b0c73c0"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:58:12.940816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-28b2c17d-a2c4-4f78-b85c-e08c97dc1604 req-5629a855-8f5d-4367-9b37-fdf9a2d1ab5d service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:12.941262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-28b2c17d-a2c4-4f78-b85c-e08c97dc1604 req-5629a855-8f5d-4367-9b37-fdf9a2d1ab5d service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:12.952929 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-28b2c17d-a2c4-4f78-b85c-e08c97dc1604 req-5629a855-8f5d-4367-9b37-fdf9a2d1ab5d service nova] Creating event network-vif-deleted:45398252-0703-42ee-96b5-f0a29b0c73c0 for instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 on hv-cinder-82549 Jul 25 12:58:12.958810 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-28b2c17d-a2c4-4f78-b85c-e08c97dc1604 req-5629a855-8f5d-4367-9b37-fdf9a2d1ab5d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032681 Jul 25 12:58:12.959550 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 596/1183] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:58:13.905630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:13.906251 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] [instance: 1c3287c8-5a26-458c-93a0-3ae6a820f3e6] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:58:13.912646 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.913095 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:13.913851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:58:13.914321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:58:13.927359 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] HTTP exception thrown: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Request method failure captured: Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 HTTP/1.1 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pIcmVC5n-xg0PYRdE9A0BiQmP_RiuSwf7GYr5qYXP-kyFmu4nsBKBw7a-U4b6-ILbJfig3-1lFr8hX_aj7V1uZo1dV1bI81ZHVi3NW9ZSVBC9bEEMPqbwjtJMJICqXE48eLRoU--yjoXiZNCWGBq-sbfma6NcvRKTXzHi410eXWOZ8 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: b7a69b02cd124acdb14727ea0711c1f8 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestShelveInstance-781047595 Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 12:58:13.928976 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7a69b02cd124acdb14727ea0711c1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b7a69b02cd124acdb14727ea0711c1f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b7a69b02cd124acdb14727ea0711c1f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b7a69b02cd124acdb14727ea0711c1f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestShelveInstance-781047595 Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: b7a69b02cd124acdb14727ea0711c1f8 Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestShelveInstance-781047595 Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestShelveInstance-781047595-project Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 42b64d8fffbc4a0fa171099d5db580a0 Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestShelveInstance-781047595-project Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. Jul 25 12:58:13.930906 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '1c3287c8-5a26-458c-93a0-3ae6a820f3e6'} Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:58:13.931991 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. Jul 25 12:58:13.933757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 12:58:13.935550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Returning 404 to user: Instance 1c3287c8-5a26-458c-93a0-3ae6a820f3e6 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:58:13.935550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f8c1fb3c-1703-4591-9feb-ac7269790093 tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6" status: 404 len: 111 microversion: 2.1 time: 0.028625 Jul 25 12:58:13.935550 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 588/1184] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:58:13 2022] GET /compute/v2.1/servers/1c3287c8-5a26-458c-93a0-3ae6a820f3e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:14.099169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d682149e-2430-4bbb-a683-be6670c1ee9c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] Calling method '.version_select at 0x7f4c2d46cd30>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:58:14.127008 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d682149e-2430-4bbb-a683-be6670c1ee9c tempest-TestShelveInstance-781047595 tempest-TestShelveInstance-781047595-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1793860161" status: 202 len: 0 microversion: 2.1 time: 0.032022 Jul 25 12:58:14.127805 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 597/1185] 10.222.0.60 () {58 vars in 1254 bytes} [Mon Jul 25 12:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1793860161 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 12:59:38.271336 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:59:38.271941 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:59:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:59:41.649645 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:59:41.650292 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 12:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:59:51.821992 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 12:59:51.822589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 12:59:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 12:59:53.369375 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=8 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:53.370067 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=16 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:53.374653 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:53.375149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:53.382563 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.383010 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.383769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.384203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.409451 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Going to try to terminate instance {{(pid=129815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 12:59:53.488307 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8830d7bc-5807-4200-a08a-57f6e9b6738e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 204 len: 0 microversion: 2.1 time: 0.119985 Jul 25 12:59:53.489600 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 589/1186] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 12:59:53 2022] DELETE /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 12:59:53.498983 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:53.499966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:53.505206 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:53.505958 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:53.515946 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.516388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.517139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:53.517569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:53.861252 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:53.869333 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-9f47ec38-5317-4a20-9e14-3e68b4e953af tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1577 microversion: 2.1 time: 0.373468 Jul 25 12:59:53.869891 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 598/1187] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:53 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1577 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:54.892087 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:54.892803 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:54.899349 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.899802 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:54.900578 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:54.901019 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:55.091707 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:55.099239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-861b1593-4691-47f4-9c12-b4e1fa53c3ab tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1577 microversion: 2.1 time: 0.211872 Jul 25 12:59:55.099807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 590/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:54 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 12:59:56.122328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:56.123525 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:56.129399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.129846 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.130744 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.131111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.200414 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:56.208804 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8f42cbff-4ddc-41e0-b919-966a98ba00d3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 200 len: 1509 microversion: 2.1 time: 0.091068 Jul 25 12:59:56.209577 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 599/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:56 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:56.268406 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-37a806a6-0052-4959-b21a-b633acb7908e req-3189c863-cae3-4df3-b8ef-55e1fafd6ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bec7a091-5227-4b72-80f6-754bd8ff366c", "name": "network-vif-deleted", "tag": "d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:56.284832 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-37a806a6-0052-4959-b21a-b633acb7908e req-3189c863-cae3-4df3-b8ef-55e1fafd6ee4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:56.285282 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-37a806a6-0052-4959-b21a-b633acb7908e req-3189c863-cae3-4df3-b8ef-55e1fafd6ee4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:56.299496 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-37a806a6-0052-4959-b21a-b633acb7908e req-3189c863-cae3-4df3-b8ef-55e1fafd6ee4 service nova] Creating event network-vif-deleted:d7cbbcaa-70c3-47ec-b05d-ff16ce29bbcd for instance bec7a091-5227-4b72-80f6-754bd8ff366c on hv-cinder-82549 Jul 25 12:59:56.305782 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-37a806a6-0052-4959-b21a-b633acb7908e req-3189c863-cae3-4df3-b8ef-55e1fafd6ee4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040964 Jul 25 12:59:56.306610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 591/1190] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 12:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 12:59:57.230071 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:57.230684 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:57.238181 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.239266 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.240121 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.240627 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.254837 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] HTTP exception thrown: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Request method failure captured: Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c HTTP/1.1 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pMEG3wmxWmiycoVmiI8_rZYFIldVkRQqaXb7eA9PnfbVNiC-He0OHlBDk2CJxwT-_iraNG75B4kfZskcpc-LZjIaagMMC1wIVZcO0E8D6nWHPOD6D9IUlPqsasapkJ8Hqqgc5BIzw7Nf9CNusJrFx_iy2ii_FUeE0uYXMJR0ONZap0 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 12:59:57.256524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-TestVolumeBootPattern-761958600 Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-TestVolumeBootPattern-761958600-project Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 318c288d31a74072b61ef089a028133d Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-TestVolumeBootPattern-761958600-project Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 12:59:57.258524 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'bec7a091-5227-4b72-80f6-754bd8ff366c'} Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 12:59:57.259822 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 12:59:57.261353 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 12:59:57.262699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Returning 404 to user: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 12:59:57.262699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8c495301-32ab-4890-b3a5-e56f33387e29 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 404 len: 111 microversion: 2.1 time: 0.031862 Jul 25 12:59:57.262699 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 600/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:57 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 12:59:57.360799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-501968498", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501702746", "security_groups": [{"name": "tempest-secgroup-smoke-2078993820"}], "block_device_mapping_v2": [{"uuid": "5e6c5be4-c2db-49f7-9286-d44b6db22107", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99391e46-f634-4a13-8d7e-0cfa93980f7c"}]}} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 12:59:57.474954 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.network.neutron [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] validate_networks() for [('99391e46-f634-4a13-8d7e-0cfa93980f7c', None, None, None, None, None)] {{(pid=129815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 12:59:57.887042 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 12:59:57.887469 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image limits 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 12:59:57.887967 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 12:59:57.888426 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image pref 0:0:0 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 12:59:57.888838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.virt.hardware [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 12:59:57.897491 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.897958 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.898757 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:57.899189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:57.915585 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 12:59:57.919985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.quota [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for user 318c288d31a74072b61ef089a028133d and project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 12:59:57.975549 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Going to run 1 instances... {{(pid=129815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 12:59:57.977767 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e6c5be4-c2db-49f7-9286-d44b6db22107',volume_size=None,volume_type=None)] {{(pid=129815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 12:59:58.108683 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-03ec174f-1d96-4b7b-9706-2a9a42e3ac99 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753243 Jul 25 12:59:58.109462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 592/1192] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 12:59:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 12:59:58.120332 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-cb991d1f-00a6-448b-8193-80302e68b0ea tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:58.120936 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-cb991d1f-00a6-448b-8193-80302e68b0ea tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:58.176256 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-cb991d1f-00a6-448b-8193-80302e68b0ea tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:58.185816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-cb991d1f-00a6-448b-8193-80302e68b0ea tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1094 microversion: 2.1 time: 0.066392 Jul 25 12:59:58.185816 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 601/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:58 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 12:59:59.204300 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 12:59:59.204905 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 12:59:59.211175 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.211833 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.212599 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 12:59:59.213207 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 12:59:59.285982 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 12:59:59.293902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4edf284d-9cce-43a7-98de-c5e18990bf02 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1210 microversion: 2.1 time: 0.094375 Jul 25 12:59:59.301685 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 593/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 12:59:59 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:00.316548 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:00.317152 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:00.324356 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.324798 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.325584 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.326107 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.536533 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:00.543970 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4072694e-ce05-4aa0-af03-ade682ec351b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.231335 Jul 25 13:00:00.545210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 602/1195] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:00 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:00.878571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-cf0b32ec-dccc-4366-9dce-0470af7e3428 req-c57fd47a-633d-418a-96da-5771120924bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289bb533-af67-497c-a897-d242455c9672", "tag": "f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:00.898579 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-cf0b32ec-dccc-4366-9dce-0470af7e3428 req-c57fd47a-633d-418a-96da-5771120924bb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:00.899939 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-cf0b32ec-dccc-4366-9dce-0470af7e3428 req-c57fd47a-633d-418a-96da-5771120924bb service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:00.916696 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-cf0b32ec-dccc-4366-9dce-0470af7e3428 req-c57fd47a-633d-418a-96da-5771120924bb service nova] Creating event network-changed:f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd for instance 289bb533-af67-497c-a897-d242455c9672 on hv-cinder-82549 Jul 25 13:00:00.924132 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-cf0b32ec-dccc-4366-9dce-0470af7e3428 req-c57fd47a-633d-418a-96da-5771120924bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049485 Jul 25 13:00:00.924735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 594/1196] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:00:01.565536 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:01.566216 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:01.572569 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.573038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.573770 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:01.574225 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:01.712001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:01.719551 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b7a082ef-6b9d-4fcb-9e7f-6e6cd85343be tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.157898 Jul 25 13:00:01.720117 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 603/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:01 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:00:02.742920 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:02.743591 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:02.750283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.750726 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.751468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:02.751894 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:02.880705 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:02.888856 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ca55e30d-10a7-4c88-bb53-a94d2b404326 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.150287 Jul 25 13:00:02.889429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 595/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:02 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:03.909884 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:03.910484 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:03.916922 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.917360 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:03.918138 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:03.918560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:04.049751 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:04.057164 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-4d16f1ef-7fdb-4431-8471-95f944576676 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.151100 Jul 25 13:00:04.057718 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 604/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:03 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:05.078759 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:05.079360 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:05.086693 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.087242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.088236 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:05.088848 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:05.224410 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:05.231818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-6fd14262-a655-4909-9ad9-975f14e058c8 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.157700 Jul 25 13:00:05.232378 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 596/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:05 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:06.252772 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:06.253381 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:06.259903 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.260341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.261132 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:06.261614 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:06.391001 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:06.398323 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-06283763-8646-4524-807d-54ea38f72341 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.149349 Jul 25 13:00:06.398875 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 605/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:06 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:07.419838 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:07.420368 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:07.426825 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.427271 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.428032 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:07.428461 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:07.561554 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:07.569009 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-997f644f-5776-4e81-8be8-1536ccb196ad tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.153069 Jul 25 13:00:07.569571 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 597/1202] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:07 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:08.590328 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:08.590931 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:08.593808 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:08.599461 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.599881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.600828 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:08.601263 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:08.732625 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:08.740169 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8af93199-d696-4951-8fd7-54718525c223 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.153690 Jul 25 13:00:08.740729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 606/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:08 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:09.760039 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:09.760686 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:09.762630 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:09.763343 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=6 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:09.769462 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.769926 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.770687 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:09.771122 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:09.898985 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:09.906463 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-10565c15-1caa-4e6d-8371-131b72983540 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.150244 Jul 25 13:00:09.907023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 598/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:09 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:10.927942 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:10.928477 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:10.934896 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.935423 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:10.936171 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:10.936597 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:11.065139 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:11.072472 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-ed56040d-7660-4a0d-ba5f-195ec832f458 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.148561 Jul 25 13:00:11.073028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 607/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:10 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:12.093309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:12.093968 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:12.094118 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-0812bdf5-507e-4524-9885-c528e60f250d req-bfbca1d2-62cf-4dc2-862f-847e1310b012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289bb533-af67-497c-a897-d242455c9672", "name": "network-vif-plugged", "status": "completed", "tag": "f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:12.100637 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:12.100854 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:12.101597 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:12.102074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:12.104210 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0812bdf5-507e-4524-9885-c528e60f250d req-bfbca1d2-62cf-4dc2-862f-847e1310b012 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:12.104613 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-0812bdf5-507e-4524-9885-c528e60f250d req-bfbca1d2-62cf-4dc2-862f-847e1310b012 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:12.117985 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-0812bdf5-507e-4524-9885-c528e60f250d req-bfbca1d2-62cf-4dc2-862f-847e1310b012 service nova] Creating event network-vif-plugged:f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd for instance 289bb533-af67-497c-a897-d242455c9672 on hv-cinder-82549 Jul 25 13:00:12.123409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-0812bdf5-507e-4524-9885-c528e60f250d req-bfbca1d2-62cf-4dc2-862f-847e1310b012 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033588 Jul 25 13:00:12.124244 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 608/1206] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:00:12.256842 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:12.265040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-60f1da24-b7ff-40f3-a10d-1c853b476bee tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.176095 Jul 25 13:00:12.265610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 599/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:12 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:13.286560 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:13.287251 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:13.293373 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.293814 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.294719 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:13.295154 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:13.423145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:13.430465 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-c6afbb33-a9ee-4c12-92fa-b2228601fc6e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1266 microversion: 2.1 time: 0.148598 Jul 25 13:00:13.431036 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 609/1208] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:13 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:14.452435 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:14.453020 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:14.459369 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.459807 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.460553 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.460977 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.589083 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:14.597030 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-5c60379b-a507-43b0-824f-db607afea40f tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1453 microversion: 2.1 time: 0.149065 Jul 25 13:00:14.597583 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 600/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:14 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:14.616990 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:00:14.617600 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:00:14.624687 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.625111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.625868 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:14.626325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:14.759416 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:00:14.767510 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-0a7efc93-a5e3-4e06-88a5-d9b6d8b62e10 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1453 microversion: 2.1 time: 0.154606 Jul 25 13:00:14.768093 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 610/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:00:14 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:00:16.347990 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-8b11e8e5-2533-48f1-b688-e20a9be2d396 req-c8f32bcc-b09b-4298-b289-b5ce756da05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289bb533-af67-497c-a897-d242455c9672", "tag": "f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:00:16.358194 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8b11e8e5-2533-48f1-b688-e20a9be2d396 req-c8f32bcc-b09b-4298-b289-b5ce756da05f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:00:16.358634 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8b11e8e5-2533-48f1-b688-e20a9be2d396 req-c8f32bcc-b09b-4298-b289-b5ce756da05f service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:00:16.369722 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-8b11e8e5-2533-48f1-b688-e20a9be2d396 req-c8f32bcc-b09b-4298-b289-b5ce756da05f service nova] Creating event network-changed:f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd for instance 289bb533-af67-497c-a897-d242455c9672 on hv-cinder-82549 Jul 25 13:00:16.375560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-8b11e8e5-2533-48f1-b688-e20a9be2d396 req-c8f32bcc-b09b-4298-b289-b5ce756da05f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031086 Jul 25 13:00:16.376570 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 601/1211] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:01:18.312583 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:01:18.313189 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:01:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:02:30.280291 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=28 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:30.281028 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=64 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:30.286286 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-210675457", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1501702746", "security_groups": [{"name": "tempest-secgroup-smoke-2078993820"}], "block_device_mapping_v2": [{"uuid": "a658cd1e-56a9-4680-ac2b-848dcd805460", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99391e46-f634-4a13-8d7e-0cfa93980f7c"}]}} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:30.396398 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.network.neutron [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] validate_networks() for [('99391e46-f634-4a13-8d7e-0cfa93980f7c', None, None, None, None, None)] {{(pid=129816) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 13:02:30.806982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 13:02:30.807396 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image limits 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 13:02:30.807864 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Flavor pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 13:02:30.808262 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Image pref 0:0:0 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 13:02:30.808664 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.virt.hardware [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129816) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 13:02:30.817940 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.818388 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.819179 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:30.819609 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:30.837455 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 13:02:30.841344 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.quota [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Getting quotas for user 318c288d31a74072b61ef089a028133d and project c09181aee1194e42a4e88b4e37592e1c. Resources: {'cores', 'ram', 'instances'} {{(pid=129816) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 13:02:30.898881 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Going to run 1 instances... {{(pid=129816) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 13:02:30.900975 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a658cd1e-56a9-4680-ac2b-848dcd805460',volume_size=None,volume_type=None)] {{(pid=129816) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 13:02:31.027628 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-b7d394cb-3d86-43b1-b486-ada26e5d2628 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749072 Jul 25 13:02:31.028254 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 611/1212] 10.222.0.60 () {60 vars in 1147 bytes} [Mon Jul 25 13:02:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 13:02:31.038691 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe702582-b432-4e6b-aee5-c9ccc1806505] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 13:02:31.039288 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:31.040023 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:31.044779 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4d427132-55ac-4686-867f-cedeaa6e7776 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:31.045478 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4d427132-55ac-4686-867f-cedeaa6e7776 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:31.105085 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4d427132-55ac-4686-867f-cedeaa6e7776 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:31.112959 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4d427132-55ac-4686-867f-cedeaa6e7776 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1094 microversion: 2.1 time: 0.077403 Jul 25 13:02:31.113517 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 602/1213] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:31 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:32.136287 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:32.136887 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:32.145140 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.145631 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.146497 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:32.146931 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:32.221080 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:32.228635 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-33fcc713-5a66-4e19-959b-598c8d250289 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1210 microversion: 2.1 time: 0.097744 Jul 25 13:02:32.229201 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 612/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:32 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:33.249438 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:33.250323 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:33.258220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:33.258718 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:33.259432 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:33.259867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:33.288537 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe702582-b432-4e6b-aee5-c9ccc1806505] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54190. Jul 25 13:02:33.414917 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:33.423313 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-8da008e5-9430-40ef-9125-ae75ba19a246 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.177691 Jul 25 13:02:33.424108 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 603/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:33 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:33.567931 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-df426a72-3e44-455c-99a7-929fbb0e907c req-af0d8f24-7983-4b4b-a7d5-0f7fd7cdb535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41234daa-52de-43f5-aad3-d0b25ecf8b2f", "tag": "2017870f-d29f-46f5-a8a8-22f4d8e5fbfe"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:33.579580 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-df426a72-3e44-455c-99a7-929fbb0e907c req-af0d8f24-7983-4b4b-a7d5-0f7fd7cdb535 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:33.580024 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-df426a72-3e44-455c-99a7-929fbb0e907c req-af0d8f24-7983-4b4b-a7d5-0f7fd7cdb535 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:33.592218 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-df426a72-3e44-455c-99a7-929fbb0e907c req-af0d8f24-7983-4b4b-a7d5-0f7fd7cdb535 service nova] Creating event network-changed:2017870f-d29f-46f5-a8a8-22f4d8e5fbfe for instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f on hv-cinder-82549 Jul 25 13:02:33.598135 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-df426a72-3e44-455c-99a7-929fbb0e907c req-af0d8f24-7983-4b4b-a7d5-0f7fd7cdb535 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102031 Jul 25 13:02:33.599175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 613/1216] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:34.444647 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:34.445203 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:34.451607 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.452049 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.452796 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:34.453220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:34.585514 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:34.592867 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d858646b-b0fc-4486-b5d5-39a4e53d38f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.152272 Jul 25 13:02:34.593429 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 604/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:34 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:35.614537 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:35.615238 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:35.621502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:35.621977 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.622740 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:35.623175 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:35.757223 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:35.764526 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-dc6c3961-eda4-4243-9b5e-c91ad3b52558 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.154862 Jul 25 13:02:35.765079 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 614/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:35 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:36.785152 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:36.785768 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:36.792126 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.792573 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:36.793328 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:36.793761 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:36.925292 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:36.932764 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-57195352-a249-4735-abbc-ecad541323f6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.152035 Jul 25 13:02:36.933324 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 605/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:36 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:37.954111 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:37.954729 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:37.961393 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.961851 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:37.962656 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:37.963087 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:38.099867 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:38.107727 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f36bdb20-dd79-4caa-9950-35c13698102b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.157464 Jul 25 13:02:38.108297 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 615/1220] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:37 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:39.131127 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:39.131735 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:39.138150 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.138598 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.139350 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:39.139818 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:39.271252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:39.278546 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-f131f24a-d9b7-40dd-98cd-d088ad389e80 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.151453 Jul 25 13:02:39.279104 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 606/1221] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:39 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:40.298870 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:40.299505 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:40.306037 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.306478 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.307227 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:40.307650 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:40.439982 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:40.447272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-18002a46-5926-4079-b8bd-be9b1d94a965 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.152282 Jul 25 13:02:40.447836 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 616/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:40 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:41.468510 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:41.469109 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:41.472074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell0:SELECT=2 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:41.477488 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.477964 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.478719 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:41.479149 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:41.608799 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:41.616417 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-57cae11e-bc85-4b02-8059-ed8fed15890c tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.151758 Jul 25 13:02:41.616973 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 607/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:41 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:42.637068 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:42.637682 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:42.639668 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=2 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:42.640341 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell0:SELECT=6 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:42.648021 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.648463 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:42.649220 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:42.649646 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:42.783055 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:42.792235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-29290c03-52e9-422f-abd7-a05de7ce7a15 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.159219 Jul 25 13:02:42.792901 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 617/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:42 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:43.813492 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:43.814189 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:43.820744 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:43.821190 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:43.821988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:43.822420 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:43.963701 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:43.976489 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-30aaf5cc-67fe-4907-81a8-05f012713270 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.166858 Jul 25 13:02:43.977063 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 608/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:43 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:44.891102 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-3772f4ad-f355-4a1b-bd31-4300a8e2880b req-1bbd0f67-e758-46ac-b18c-431ee57df60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41234daa-52de-43f5-aad3-d0b25ecf8b2f", "name": "network-vif-plugged", "status": "completed", "tag": "2017870f-d29f-46f5-a8a8-22f4d8e5fbfe"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:44.901003 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-3772f4ad-f355-4a1b-bd31-4300a8e2880b req-1bbd0f67-e758-46ac-b18c-431ee57df60a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:44.901443 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-3772f4ad-f355-4a1b-bd31-4300a8e2880b req-1bbd0f67-e758-46ac-b18c-431ee57df60a service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:44.913611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-3772f4ad-f355-4a1b-bd31-4300a8e2880b req-1bbd0f67-e758-46ac-b18c-431ee57df60a service nova] Creating event network-vif-plugged:2017870f-d29f-46f5-a8a8-22f4d8e5fbfe for instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f on hv-cinder-82549 Jul 25 13:02:44.918703 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-3772f4ad-f355-4a1b-bd31-4300a8e2880b req-1bbd0f67-e758-46ac-b18c-431ee57df60a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094943 Jul 25 13:02:44.919305 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 618/1226] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:44.998633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:45.000072 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:45.006937 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.007384 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.008508 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:45.008844 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:45.162409 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:45.170555 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-4b4f4299-a92d-4119-ad53-0861000edd87 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.176473 Jul 25 13:02:45.171142 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 609/1227] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:44 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:02:46.193618 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:46.194338 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:46.200481 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:46.200924 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:46.201676 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:46.202145 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:46.339337 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:46.346799 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d7999d36-98d1-4514-acee-24eb4e5b6708 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1266 microversion: 2.1 time: 0.157854 Jul 25 13:02:46.347366 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 619/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:46 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:47.368473 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:47.369206 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:47.375712 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.376100 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.376858 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.377294 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.511769 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:47.519658 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-64b0d399-b2f0-40e8-aada-b6c57c6eebd1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1453 microversion: 2.1 time: 0.155351 Jul 25 13:02:47.520252 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 610/1229] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:47 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:47.540038 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:02:47.540643 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:02:47.547133 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.547581 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.548334 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:47.548766 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:47.676780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:02:47.684193 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-83baa887-fa5a-4a0b-ba3a-10f837c1c4a6 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1453 microversion: 2.1 time: 0.147955 Jul 25 13:02:47.684753 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 620/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:02:47 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:02:49.593113 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-dbd41ed5-0345-4045-a548-247585d2d872 req-cf8da2a4-4e36-4de7-ac8b-610336cb65f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41234daa-52de-43f5-aad3-d0b25ecf8b2f", "tag": "2017870f-d29f-46f5-a8a8-22f4d8e5fbfe"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:02:49.602808 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-dbd41ed5-0345-4045-a548-247585d2d872 req-cf8da2a4-4e36-4de7-ac8b-610336cb65f8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:02:49.603247 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-dbd41ed5-0345-4045-a548-247585d2d872 req-cf8da2a4-4e36-4de7-ac8b-610336cb65f8 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:02:49.613864 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-dbd41ed5-0345-4045-a548-247585d2d872 req-cf8da2a4-4e36-4de7-ac8b-610336cb65f8 service nova] Creating event network-changed:2017870f-d29f-46f5-a8a8-22f4d8e5fbfe for instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f on hv-cinder-82549 Jul 25 13:02:49.619139 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-dbd41ed5-0345-4045-a548-247585d2d872 req-cf8da2a4-4e36-4de7-ac8b-610336cb65f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029782 Jul 25 13:02:49.619925 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 611/1231] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:02:58.280339 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:02:58.281035 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:03:11.831309 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:03:11.832040 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:04:38.320925 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:04:38.321591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:04:39.520778 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe702582-b432-4e6b-aee5-c9ccc1806505] AMQP server on 10.222.0.60:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 25 13:04:39.522144 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_api:SELECT=22 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:39.523283 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG dbcounter [-] [129815] Writing DB stats nova_cell1:SELECT=50 {{(pid=129815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:39.523438 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:39.523838 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:39.526611 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:39.527591 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG dbcounter [-] [129816] Writing DB stats nova_cell1:SELECT=48 {{(pid=129816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:39.528775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-74bd6796-fce1-4ec6-96ca-4a774241a676 req-0f9c5527-6eec-4016-932e-742da5621091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41234daa-52de-43f5-aad3-d0b25ecf8b2f", "tag": "2017870f-d29f-46f5-a8a8-22f4d8e5fbfe"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:39.536031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.536488 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.537339 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.537976 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.541459 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-74bd6796-fce1-4ec6-96ca-4a774241a676 req-0f9c5527-6eec-4016-932e-742da5621091 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.542082 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-74bd6796-fce1-4ec6-96ca-4a774241a676 req-0f9c5527-6eec-4016-932e-742da5621091 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.553487 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-74bd6796-fce1-4ec6-96ca-4a774241a676 req-0f9c5527-6eec-4016-932e-742da5621091 service nova] Creating event network-changed:2017870f-d29f-46f5-a8a8-22f4d8e5fbfe for instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f on hv-cinder-82549 Jul 25 13:04:39.559211 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-74bd6796-fce1-4ec6-96ca-4a774241a676 req-0f9c5527-6eec-4016-932e-742da5621091 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040458 Jul 25 13:04:39.560610 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 612/1232] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 13:04:39.566589 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:04:39.671120 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-8781efe6-998e-4087-a561-09ac51a35522 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "DELETE /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 204 len: 0 microversion: 2.1 time: 0.154387 Jul 25 13:04:39.672066 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 621/1233] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 13:04:39 2022] DELETE /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:04:39.682421 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:39.683126 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:39.689809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.690338 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.691111 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:39.691540 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:39.840064 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:39.847946 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-46a08e50-5eed-4bfa-9e52-3c1480b142c1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1578 microversion: 2.1 time: 0.169787 Jul 25 13:04:39.848518 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 613/1234] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:39 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:40.869966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:40.870655 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:40.877235 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.877675 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:40.878479 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:40.878902 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:41.043278 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:41.051161 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-7e592f69-4762-4df8-b417-ed87aa2372e3 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1578 microversion: 2.1 time: 0.185466 Jul 25 13:04:41.051848 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 622/1235] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:40 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:41.661088 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:04:41.661335 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:04:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:04:42.072689 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:42.073370 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:42.081239 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.081692 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.082633 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.083071 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.088741 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe702582-b432-4e6b-aee5-c9ccc1806505] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 54302. Jul 25 13:04:42.234321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:42.240796 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [req-11e70093-723d-45bd-9785-ff4c46b6a647 req-8934039d-a567-4ddc-9c3f-2c2d9bd909d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41234daa-52de-43f5-aad3-d0b25ecf8b2f", "name": "network-vif-deleted", "tag": "2017870f-d29f-46f5-a8a8-22f4d8e5fbfe"}]} {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:42.243924 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-c8d80fc1-2a0d-4f6d-82e7-e73de87baec4 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 200 len: 1459 microversion: 2.1 time: 0.175122 Jul 25 13:04:42.244902 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 614/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:42 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 1459 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:42.261049 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-11e70093-723d-45bd-9785-ff4c46b6a647 req-8934039d-a567-4ddc-9c3f-2c2d9bd909d4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:42.261832 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [req-11e70093-723d-45bd-9785-ff4c46b6a647 req-8934039d-a567-4ddc-9c3f-2c2d9bd909d4 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:42.283272 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.compute.server_external_events [req-11e70093-723d-45bd-9785-ff4c46b6a647 req-8934039d-a567-4ddc-9c3f-2c2d9bd909d4 service nova] Creating event network-vif-deleted:2017870f-d29f-46f5-a8a8-22f4d8e5fbfe for instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f on hv-cinder-82549 Jul 25 13:04:42.291313 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [req-11e70093-723d-45bd-9785-ff4c46b6a647 req-8934039d-a567-4ddc-9c3f-2c2d9bd909d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059515 Jul 25 13:04:42.292030 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 623/1237] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:43.265680 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:43.266289 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 41234daa-52de-43f5-aad3-d0b25ecf8b2f] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:43.272770 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:43.273220 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:43.274027 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:43.274467 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:43.287919 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] HTTP exception thrown: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Request method failure captured: Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f HTTP/1.1 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pMEG3wmxWmiycoVmiI8_rZYFIldVkRQqaXb7eA9PnfbVNiC-He0OHlBDk2CJxwT-_iraNG75B4kfZskcpc-LZjIaagMMC1wIVZcO0E8D6nWHPOD6D9IUlPqsasapkJ8Hqqgc5BIzw7Nf9CNusJrFx_iy2ii_FUeE0uYXMJR0ONZap0 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 13:04:43.289566 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 318c288d31a74072b61ef089a028133d Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. Jul 25 13:04:43.291422 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '41234daa-52de-43f5-aad3-d0b25ecf8b2f'} Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:04:43.292751 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. Jul 25 13:04:43.296184 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:43.298851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Returning 404 to user: Instance 41234daa-52de-43f5-aad3-d0b25ecf8b2f could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:04:43.298851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-e665e297-9a51-48f7-a91e-c11fef2d726e tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f" status: 404 len: 111 microversion: 2.1 time: 0.029492 Jul 25 13:04:43.298851 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 615/1238] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:43 2022] GET /compute/v2.1/servers/41234daa-52de-43f5-aad3-d0b25ecf8b2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:04:46.626821 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:46.627417 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:46.628560 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-8670b178-f6b9-4ad0-8480-218e7dae1db5 req-7fa5c5dd-028e-456e-b78b-a80fcf4f08f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289bb533-af67-497c-a897-d242455c9672", "tag": "f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:46.634752 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.635502 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.636519 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.636960 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.638836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8670b178-f6b9-4ad0-8480-218e7dae1db5 req-7fa5c5dd-028e-456e-b78b-a80fcf4f08f1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.639279 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-8670b178-f6b9-4ad0-8480-218e7dae1db5 req-7fa5c5dd-028e-456e-b78b-a80fcf4f08f1 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.650775 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-8670b178-f6b9-4ad0-8480-218e7dae1db5 req-7fa5c5dd-028e-456e-b78b-a80fcf4f08f1 service nova] Creating event network-changed:f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd for instance 289bb533-af67-497c-a897-d242455c9672 on hv-cinder-82549 Jul 25 13:04:46.656428 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-8670b178-f6b9-4ad0-8480-218e7dae1db5 req-7fa5c5dd-028e-456e-b78b-a80fcf4f08f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031514 Jul 25 13:04:46.657291 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 616/1239] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:46.665677 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Going to try to terminate instance {{(pid=129816) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 13:04:46.758399 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-148c826c-664a-4535-baea-0fe7fbac0bc1 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "DELETE /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 204 len: 0 microversion: 2.1 time: 0.135596 Jul 25 13:04:46.759325 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 624/1240] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 13:04:46 2022] DELETE /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 13:04:46.768261 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:46.769051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:46.777756 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.778232 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.779214 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:46.779850 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:46.930893 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.policy [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129815) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:46.938564 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-d8fd0db5-15a5-461a-bf0a-3938043b9a23 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1578 microversion: 2.1 time: 0.174628 Jul 25 13:04:46.939138 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 617/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:46 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:47.960289 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:47.960974 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:47.967487 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.967926 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:47.968732 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:47.969113 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:48.158026 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:48.165705 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-d51f11e1-2866-40d4-8c44-e638041c77f9 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1578 microversion: 2.1 time: 0.209577 Jul 25 13:04:48.166383 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 625/1242] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:47 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 13:04:49.149415 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [req-e314e689-7533-497f-96d7-70c9f241ee57 req-5f8359c7-d4c2-4cdc-8db8-85727e34e589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289bb533-af67-497c-a897-d242455c9672", "name": "network-vif-deleted", "tag": "f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd"}]} {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 13:04:49.162051 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-e314e689-7533-497f-96d7-70c9f241ee57 req-5f8359c7-d4c2-4cdc-8db8-85727e34e589 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.162479 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [req-e314e689-7533-497f-96d7-70c9f241ee57 req-5f8359c7-d4c2-4cdc-8db8-85727e34e589 service nova] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.186874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.compute.server_external_events [req-e314e689-7533-497f-96d7-70c9f241ee57 req-5f8359c7-d4c2-4cdc-8db8-85727e34e589 service nova] Creating event network-vif-deleted:f6bf45e0-ca0e-4b1f-ac37-854d4cc6c5dd for instance 289bb533-af67-497c-a897-d242455c9672 on hv-cinder-82549 Jul 25 13:04:49.190949 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:49.191626 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:49.194820 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [req-e314e689-7533-497f-96d7-70c9f241ee57 req-5f8359c7-d4c2-4cdc-8db8-85727e34e589 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049694 Jul 25 13:04:49.195771 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 618/1243] 10.222.0.60 () {64 vars in 1317 bytes} [Mon Jul 25 13:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 13:04:49.200402 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.200939 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.201780 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:49.202249 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:49.268386 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.policy [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '318c288d31a74072b61ef089a028133d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09181aee1194e42a4e88b4e37592e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129816) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 13:04:49.275966 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-6212f3c7-700f-4d6f-b0b8-e60a0e1f5817 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 200 len: 1225 microversion: 2.1 time: 0.089603 Jul 25 13:04:49.276540 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 626/1244] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:49 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 13:04:50.299582 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:50.300358 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: 289bb533-af67-497c-a897-d242455c9672] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:50.307242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.307695 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.308448 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.308874 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.324656 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] HTTP exception thrown: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Request method failure captured: Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 HTTP/1.1 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pMEG3wmxWmiycoVmiI8_rZYFIldVkRQqaXb7eA9PnfbVNiC-He0OHlBDk2CJxwT-_iraNG75B4kfZskcpc-LZjIaagMMC1wIVZcO0E8D6nWHPOD6D9IUlPqsasapkJ8Hqqgc5BIzw7Nf9CNusJrFx_iy2ii_FUeE0uYXMJR0ONZap0 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 13:04:50.326318 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 318c288d31a74072b61ef089a028133d Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. Jul 25 13:04:50.328188 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': '289bb533-af67-497c-a897-d242455c9672'} Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:04:50.329242 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. Jul 25 13:04:50.331097 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.333218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Returning 404 to user: Instance 289bb533-af67-497c-a897-d242455c9672 could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:04:50.333218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-31cd1113-ad65-414f-bea9-2f2488457d03 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672" status: 404 len: 111 microversion: 2.1 time: 0.032981 Jul 25 13:04:50.333218 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 619/1245] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:50 2022] GET /compute/v2.1/servers/289bb533-af67-497c-a897-d242455c9672 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:04:50.779200 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:50.779747 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.compute.api [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129816) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:50.787409 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.787850 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.788644 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.789069 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG oslo_concurrency.lockutils [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.802268 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.wsgi [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] HTTP exception thrown: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Request method failure captured: Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: request: DELETE /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c HTTP/1.1 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept: application/json Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Accept-Encoding: identity Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Connection: close Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Length: 0 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Content-Type: application/json Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Host: 10.222.0.60 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Openstack-System-Scope: None Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: User-Agent: python-urllib3/1.26.10 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Auth-Token: gAAAAABi3pMEG3wmxWmiycoVmiI8_rZYFIldVkRQqaXb7eA9PnfbVNiC-He0OHlBDk2CJxwT-_iraNG75B4kfZskcpc-LZjIaagMMC1wIVZcO0E8D6nWHPOD6D9IUlPqsasapkJ8Hqqgc5BIzw7Nf9CNusJrFx_iy2ii_FUeE0uYXMJR0ONZap0 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Id: None Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Domain-Name: None Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Identity-Status: Confirmed Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Is-Admin-Project: True Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Id: default Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Domain-Name: Default Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Project-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Role: member,reader Jul 25 13:04:50.803921 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Roles: member,reader Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-Tenant-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Id: default Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Domain-Name: Default Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Id: 318c288d31a74072b61ef089a028133d Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: X-User-Name: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: method: > Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: exception: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.805669 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: action_args: {'id': 'bec7a091-5227-4b72-80f6-754bd8ff366c'} Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:04:50.806686 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.808343 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.810034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Returning 404 to user: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. {{(pid=129816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:04:50.810034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-f0959684-c5d7-4066-83c9-abb60b630565 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "DELETE /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 404 len: 111 microversion: 2.1 time: 0.030043 Jul 25 13:04:50.810034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 627/1246] 10.222.0.60 () {58 vars in 1239 bytes} [Mon Jul 25 13:04:50 2022] DELETE /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:04:50.814227 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '>' {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:50.814836 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.compute.api [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] [instance: bec7a091-5227-4b72-80f6-754bd8ff366c] Fetching instance by UUID {{(pid=129815) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 13:04:50.820873 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.821321 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.822154 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 13:04:50.822589 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG oslo_concurrency.lockutils [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Lock "fa515c24-2446-4072-8c71-57a58390eeef" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 13:04:50.836529 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.wsgi [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] HTTP exception thrown: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Request method failure captured: Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: request: GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c HTTP/1.1 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept: application/json Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Accept-Encoding: identity Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Connection: close Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Length: 0 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Content-Type: application/json Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Host: 10.222.0.60 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Openstack-System-Scope: None Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: User-Agent: python-urllib3/1.26.10 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Auth-Token: gAAAAABi3pMEG3wmxWmiycoVmiI8_rZYFIldVkRQqaXb7eA9PnfbVNiC-He0OHlBDk2CJxwT-_iraNG75B4kfZskcpc-LZjIaagMMC1wIVZcO0E8D6nWHPOD6D9IUlPqsasapkJ8Hqqgc5BIzw7Nf9CNusJrFx_iy2ii_FUeE0uYXMJR0ONZap0 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Id: None Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Domain-Name: None Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Identity-Status: Confirmed Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Is-Admin-Project: True Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Id: default Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Domain-Name: Default Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Project-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Role: member,reader Jul 25 13:04:50.838074 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Roles: member,reader Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c09181aee1194e42a4e88b4e37592e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}] Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Id: c09181aee1194e42a4e88b4e37592e1c Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-Tenant-Name: tempest-TestVolumeBootPattern-761958600 Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Id: default Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Domain-Name: Default Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Id: 318c288d31a74072b61ef089a028133d Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: X-User-Name: tempest-TestVolumeBootPattern-761958600-project Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: method: > Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: exception: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.839813 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: action_args: {'id': 'bec7a091-5227-4b72-80f6-754bd8ff366c'} Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: {{(pid=129815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 13:04:50.840809 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. Jul 25 13:04:50.842482 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: ERROR nova.api.openstack.wsgi Jul 25 13:04:50.843979 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: DEBUG nova.api.openstack.wsgi [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Returning 404 to user: Instance bec7a091-5227-4b72-80f6-754bd8ff366c could not be found. {{(pid=129815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 13:04:50.843979 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO nova.api.openstack.requestlog [None req-ade20e8f-ec7a-4082-98fa-005baf72524b tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c" status: 404 len: 111 microversion: 2.1 time: 0.029010 Jul 25 13:04:50.843979 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: [pid: 129815|app: 0|req: 620/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Mon Jul 25 13:04:50 2022] GET /compute/v2.1/servers/bec7a091-5227-4b72-80f6-754bd8ff366c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 13:04:52.135542 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: DEBUG nova.api.openstack.wsgi [None req-294e581b-2634-48b5-a918-6ac1dc0f7953 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] Calling method '.version_select at 0x7f4c2d39bc10>' {{(pid=129816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 13:04:52.160034 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO nova.api.openstack.requestlog [None req-294e581b-2634-48b5-a918-6ac1dc0f7953 tempest-TestVolumeBootPattern-761958600 tempest-TestVolumeBootPattern-761958600-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1501702746" status: 202 len: 0 microversion: 2.1 time: 0.028116 Jul 25 13:04:52.160538 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: [pid: 129816|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1263 bytes} [Mon Jul 25 13:04:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1501702746 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 13:06:18.289792 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:06:18.290468 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:06:31.840879 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:06:31.841664 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:06:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:07:58.329330 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:07:58.330031 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:07:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:08:01.669231 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:08:01.670157 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:09:38.298457 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:09:38.299123 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:09:51.849988 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:09:51.850806 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:09:56.754137 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:09:56.754949 dv-cinder-825492-28-iscsi devstack@n-api.service[129815]: Mon Jul 25 13:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 13:10:03.322999 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 13:10:03.323608 dv-cinder-825492-28-iscsi devstack@n-api.service[129816]: Mon Jul 25 13:10:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!